Sep 28 18:53:52 devstack cinder-volume[75385]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:53:52 devstack cinder-volume[75385]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:53:52 devstack cinder-volume[75385]: we strongly recommend against using it for new projects. Sep 28 18:53:52 devstack cinder-volume[75385]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:53:52 devstack cinder-volume[75385]: framework. For more detail see Sep 28 18:53:52 devstack cinder-volume[75385]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:53:52 devstack cinder-volume[75385]: import eventlet # noqa Sep 28 18:53:55 devstack cinder-volume[75385]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:53:55 devstack cinder-volume[75385]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:53:55 devstack cinder-volume[75385]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:53:56 devstack cinder-volume[75385]: INFO dbcounter [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Registered counter for database cinder Sep 28 18:53:56 devstack cinder-volume[75385]: DEBUG oslo_db.sqlalchemy.engines [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:53:56 devstack cinder-volume[75385]: DEBUG dbcounter [-] [75385] Writer thread running {{(pid=75385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:53:56 devstack cinder-volume[75385]: INFO cinder.rpc [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:53:56 devstack cinder-volume[75385]: INFO cinder.rpc [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_db.sqlalchemy.engines [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:53:57 devstack cinder-volume[75385]: INFO cinder.volume.manager [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Determined volume DB was empty at startup. Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG cinder.volume.manager [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75385) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:53:57 devstack cinder-volume[75385]: INFO cinder.volume.manager [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 18:53:57 devstack cinder-volume[75385]: WARNING stevedore.named [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:53:57 devstack cinder-volume[75385]: WARNING castellan.key_manager [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:53:57 devstack cinder-volume[75385]: WARNING cinder.keymgr.conf_key_mgr [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG cinder.volume.drivers.lvm [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75385) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.511s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_db.sqlalchemy.engines [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:53:57 devstack cinder-volume[75385]: INFO cinder.rpc [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 18:53:57 devstack cinder-volume[75385]: INFO cinder.rpc [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 18:53:57 devstack cinder-volume[75385]: WARNING stevedore.named [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:53:57 devstack cinder-volume[75385]: WARNING castellan.key_manager [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:53:57 devstack cinder-volume[75385]: INFO cinder.volume.manager [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_db.sqlalchemy.engines [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:53:57 devstack cinder-volume[75385]: INFO oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Starting 1 workers Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Started child 75562 {{(pid=75385) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:53:57 devstack cinder-volume[75562]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Full set of CONF: {{(pid=75385) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] ******************************************************************************** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Configuration options gathered from: {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] ================================================================================ {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] allow_availability_zone_fallback = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] allow_compression_on_image_upload = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] allowed_direct_url_schemes = [] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] api_rate_limit = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] auth_strategy = keystone {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] az_cache_duration = 3600 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_availability_zone = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_host = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_name = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_stats_polling_interval = 60 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backup_api_class = cinder.backup.api.API {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backup_name_template = backup-%s {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backup_use_same_host = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backup_use_temp_snapshot = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] chap_password = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] chap_username = {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cinder_internal_tenant_project_id = 26cde7cd9a0a4e169d97266ff4734055 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cinder_internal_tenant_user_id = bffe35ad3a244b1599d8d46ce74a6b3e {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cloned_volume_same_az = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cluster = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] compression_format = gzip {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] compute_api_class = cinder.compute.nova.API {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] config_dir = [] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] config_source = [] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] control_exchange = openstack {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] debug = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] default_availability_zone = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] default_group_type = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] default_volume_type = lvmdriver-1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] disk_geometry = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] driver_client_cert = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] driver_client_cert_key = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] driver_data_namespace = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] driver_ssl_cert_path = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] driver_ssl_cert_verify = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] driver_use_ssl = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] enable_force_upload = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] enable_new_services = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] enable_unsupported_driver = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] enforce_multipath_for_image_xfer = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] filter_function = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance_api_insecure = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance_api_servers = ['http://192.168.122.215/image'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance_api_ssl_compression = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance_ca_certificates_file = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance_catalog_info = image:glance:publicURL {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance_certfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance_keyfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance_num_retries = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance_request_timeout = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] goodness_function = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] graceful_shutdown_timeout = 5 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] group_api_class = cinder.group.api.API {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] host = devstack {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_compress_on_upload = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_conversion_address_space_limit = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_conversion_cpu_limit = 60 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_conversion_disable = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_introspection_address_space_limit = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_introspection_cpu_limit = 60 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_upload_use_cinder_backend = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_upload_use_internal_tenant = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_volume_cache_enabled = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_volume_cache_max_count = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] image_volume_cache_max_size_gb = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] init_host_max_objects_retrieval = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] instance_format = [instance: %(uuid)s] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] iscsi_target_flags = {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] iscsi_write_cache = on {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] iser_helper = tgtadm {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] iser_ip_address = 192.168.122.215 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] iser_port = 3260 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] log_color = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] log_config_append = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75562]: INFO cinder.volume.manager [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 18:53:57 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] log_dir = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] log_file = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] log_options = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] log_rotate_interval = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] log_rotate_interval_type = days {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] log_rotation_type = none {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] max_age = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] max_logfile_count = 30 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] max_logfile_size_mb = 200 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] max_over_subscription_ratio = 20.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] message_reap_interval = 86400 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] message_ttl = 2592000 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] migration_create_volume_timeout_secs = 300 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] monkey_patch = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] monkey_patch_modules = [] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] my_ip = 192.168.122.215 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] no_snapshot_gb_quota = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] num_iser_scan_tries = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] num_shell_tries = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] num_volume_device_scan_tries = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] nvmeof_conn_info_version = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] nvmet_ns_id = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] nvmet_port_id = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] osapi_max_limit = 1000 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] osapi_volume_ext_list = [] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] osapi_volume_listen_port = 8776 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] osapi_volume_use_ssl = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] osapi_volume_workers = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] per_volume_size_limit = -1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] periodic_fuzzy_delay = 60 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] periodic_interval = 60 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] public_endpoint = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] publish_errors = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] quota_backup_gigabytes = 1000 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] quota_backups = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] quota_gigabytes = 1000 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] quota_groups = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] quota_snapshots = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] quota_volumes = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] rate_limit_burst = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] rate_limit_except_level = CRITICAL {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] rate_limit_interval = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] reinit_driver_count = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] replication_device = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] report_discard_supported = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] report_interval = 120 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] reservation_clean_interval = 86400 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] reservation_expire = 86400 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] reserved_image_namespaces = [] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] reserved_percentage = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] rpc_response_timeout = 120 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] run_external_periodic_tasks = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] scst_target_driver = iscsi {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] scst_target_iqn_name = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_down_time = 720 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] shell_completion = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] snapshot_name_template = snapshot-%s {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] snapshot_same_host = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] split_loggers = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] state_path = /opt/stack/data/cinder {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] storage_availability_zone = nova {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] storage_protocol = iSCSI {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] syslog_log_facility = LOG_USER {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] target_helper = lioadm {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] target_ip_address = 192.168.122.215 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] target_port = 3260 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] target_protocol = iscsi {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] target_secondary_ip_addresses = [] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] trace_flags = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] transport_url = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] until_refresh = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] use_chap_auth = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] use_default_quota_class = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] use_journal = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] use_json = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] use_multipath_for_image_xfer = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] use_stderr = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] use_syslog = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] verify_glance_signatures = enabled {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_api_class = cinder.volume.api.API {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_backend_name = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_clear = zero {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_clear_ionice = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_clear_size = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_copy_bps_limit = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_dd_blocksize = 1M {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_name_template = volume-%s {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_service_inithost_offload = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volume_usage_audit_period = month {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] zoning_mode = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_concurrency.disable_process_locking = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:57 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.auth_section = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.auth_type = password {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.auth_version = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.cache = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.certfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.include_service_catalog = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.insecure = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.interface = public {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.keyfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_password = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcache_username = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.region_name = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.service_type = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.215/identity {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.backend = dogpile.cache.null {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:57 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.backend_argument = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.backend_expiration_time = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.config_prefix = cache.oslo {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.debug_cache_backend = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.enable_retry_client = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.enable_socket_keepalive = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.enabled = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.expiration_time = 600 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.hashclient_retry_attempts = 2 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.memcache_dead_retry = 300 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.memcache_pool_maxsize = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.memcache_sasl_enabled = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.password = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.proxies = [] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.redis_db = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.redis_server = localhost:6379 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.retry_attempts = 2 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.retry_delay = 0.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.socket_keepalive_count = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.socket_keepalive_idle = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.socket_keepalive_interval = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.socket_timeout = 1.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.tls_allowed_ciphers = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.tls_cafile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.tls_certfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.tls_enabled = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.tls_keyfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cache.username = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] coordination.backend_url = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.asyncio_connection = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.asyncio_slave_connection = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.backend = sqlalchemy {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.connection = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.connection_debug = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.connection_parameters = {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.connection_recycle_time = 3600 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.connection_trace = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.db_inc_retry_interval = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.db_max_retries = 20 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.db_max_retry_interval = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.db_retry_interval = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.max_overflow = 50 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.max_pool_size = 5 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.max_retries = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.mysql_wsrep_sync_wait = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.pool_timeout = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.retry_interval = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.slave_connection = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.sqlite_synchronous = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.synchronous_reader = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] database.use_db_reconnect = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_tracing.insecure = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.connection_string = messaging:// {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.enabled = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.es_doc_type = notification {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.es_scroll_size = 10000 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.es_scroll_time = 2m {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.filter_error_trace = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.hmac_keys = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.sentinel_service_name = mymaster {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.socket_timeout = 0.1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.trace_requests = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler.trace_sqlalchemy = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler_jaeger.process_tags = {} {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler_jaeger.service_name_prefix = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] profiler_otlp.service_name_prefix = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_policy.enforce_new_defaults = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_policy.policy_default_rule = default {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_policy.policy_file = policy.yaml {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] privsep_osbrick.group = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] privsep_osbrick.helper_command = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack sudo[75628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] privsep_osbrick.user = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cinder_sys_admin.group = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cinder_sys_admin.helper_command = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack sudo[75628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] cinder_sys_admin.user = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.auth_section = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.auth_type = password {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.cafile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.certfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.collect_timing = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.insecure = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.keyfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.send_service_user_token = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.split_loggers = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.timeout = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.tls_ciphers = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] service_user.tls_min_version = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.auth_section = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.auth_type = password {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.certfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.collect_timing = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.insecure = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.keyfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.region_name = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.split_loggers = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.timeout = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.tls_ciphers = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] glance.tls_min_version = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.backend_availability_zone = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.chap_password = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.chap_username = {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.disk_geometry = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.driver_client_cert = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.driver_client_cert_key = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.driver_data_namespace = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.driver_use_ssl = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.extra_capabilities = {} {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.filter_function = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.goodness_function = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.iscsi_target_flags = {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.iscsi_write_cache = on {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.iser_helper = tgtadm {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.iser_ip_address = 192.168.122.215 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.iser_port = 3260 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.lvm_share_target = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.lvm_type = auto {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.num_shell_tries = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.replication_device = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.report_discard_supported = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.reserved_percentage = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.target_helper = tgtadm {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.target_ip_address = 192.168.122.215 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.target_port = 3260 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.target_protocol = iscsi {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.trace_flags = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.unique_fqdn_network = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.use_chap_auth = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.volume_backend_name = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.volume_clear = zero {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.volume_clear_ionice = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.volume_clear_size = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_reports.file_event_handler = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_reports.log_dir = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.backend_host = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.chap_password = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.chap_username = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.disk_geometry = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.driver_client_cert = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.extra_capabilities = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.filter_function = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.goodness_function = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.iser_helper = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.iser_ip_address = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.iser_port = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.lvm_share_target = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.lvm_type = auto {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.num_shell_tries = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.replication_device = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.report_discard_supported = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.reserved_percentage = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.scst_target_driver = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.storage_protocol = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.target_helper = lioadm {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.target_ip_address = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.target_port = 3260 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.trace_flags = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.use_chap_auth = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.volume_clear = zero {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.volume_clear_size = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] lvmdriver-1.volumes_dir = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.ssl = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_notifications.driver = [] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_notifications.retry = -1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] key_manager.fixed_key = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.barbican_api_version = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.barbican_endpoint = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.barbican_endpoint_type = public {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.barbican_region_name = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.cafile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.certfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.collect_timing = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.insecure = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.keyfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.number_of_retries = 60 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.retry_delay = 1 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.send_service_user_token = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.split_loggers = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.timeout = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.tls_ciphers = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.tls_min_version = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.verify_ssl = True {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican.verify_ssl_path = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.auth_section = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.auth_type = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.cafile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.certfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.collect_timing = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.insecure = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.keyfile = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.split_loggers = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.timeout = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.tls_ciphers = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] barbican_service_user.tls_min_version = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.approle_role_id = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.approle_secret_id = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.auth_method = approle {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.auth_path = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.kv_mountpoint = secret {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.kv_path = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.kv_version = 2 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.namespace = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.root_token_id = **** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.ssl_ca_crt_file = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.timeout = 60.0 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.token_file = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.token_role = None {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.use_ssl = False {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:53:58 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] ******************************************************************************** {{(pid=75385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:53:58 devstack sudo[75628]: pam_unix(sudo:session): session closed for user root Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.349s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:58 devstack sudo[75738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:53:58 devstack sudo[75738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:53:58 devstack sudo[75738]: pam_unix(sudo:session): session closed for user root Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.249s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:53:58 devstack cinder-volume[75562]: INFO cinder.brick.local_dev.lvm [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:58 devstack sudo[75824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:53:58 devstack sudo[75824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:53:58 devstack sudo[75824]: pam_unix(sudo:session): session closed for user root Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG cinder.brick.local_dev.lvm [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75562) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 18:53:58 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:58 devstack sudo[75906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:53:58 devstack sudo[75906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:53:59 devstack sudo[75906]: pam_unix(sudo:session): session closed for user root Sep 28 18:53:59 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.528s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:59 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:59 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:59 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:59 devstack sudo[76070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:53:59 devstack sudo[76070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:53:59 devstack sudo[76070]: pam_unix(sudo:session): session closed for user root Sep 28 18:53:59 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:59 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:59 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:53:59 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:53:59 devstack sudo[76146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 18:53:59 devstack sudo[76146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:00 devstack sudo[76146]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:00 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.320s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:00 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:00 devstack sudo[76218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:54:00 devstack sudo[76218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:00 devstack sudo[76218]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:00 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:00 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:00 devstack sudo[76269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:54:00 devstack sudo[76269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:00 devstack sudo[76269]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:00 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.365s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:00 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:00 devstack sudo[76358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:54:00 devstack sudo[76358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:01 devstack sudo[76358]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:01 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:01 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:01 devstack sudo[76361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:54:01 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:01 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:01 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:01 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:01 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:01 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:01 devstack sudo[76371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:54:01 devstack sudo[76371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:01 devstack sudo[76371]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:01 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:01 devstack cinder-volume[75562]: INFO cinder.volume.drivers.lvm [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 18:54:01 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:01 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:01 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:01 devstack sudo[76375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:54:01 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:02 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:02 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:02 devstack cinder-volume[75562]: DEBUG cinder.volume.drivers.lvm [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Updating volume stats {{(pid=75562) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:54:02 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:02 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:54:02 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:02 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:02 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:02 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:02 devstack sudo[76381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:54:02 devstack sudo[76381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:02 devstack sudo[76381]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:02 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:02 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:02 devstack sudo[76384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:54:02 devstack sudo[76384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:02 devstack sudo[76384]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:02 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:02 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:02 devstack sudo[76388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:54:02 devstack sudo[76388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:03 devstack sudo[76388]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:03 devstack cinder-volume[75562]: INFO cinder.volume.driver [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG cinder.volume.driver [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75562) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG oslo_db.sqlalchemy.engines [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75562) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG dbcounter [-] [75562] Writer thread running {{(pid=75562) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG cinder.db.api [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Building query based on filter {{(pid=75562) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG cinder.image.image_utils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75562) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:54:03 devstack cinder-volume[75562]: INFO cinder.keymgr.migration [None req-89907c33-f453-481e-87be-8d1b68838c6c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG cinder.volume.drivers.lvm [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Updating volume stats {{(pid=75562) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:03 devstack sudo[76394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:54:03 devstack sudo[76394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:03 devstack sudo[76394]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:03 devstack sudo[76397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:54:03 devstack sudo[76397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:03 devstack sudo[76397]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:03 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:04 devstack sudo[76400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:54:04 devstack sudo[76400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:04 devstack sudo[76400]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:04 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:04 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:04 devstack sudo[76403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:54:04 devstack sudo[76403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:04 devstack sudo[76403]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:04 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:04 devstack cinder-volume[75562]: DEBUG cinder.manager [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Notifying Schedulers of capabilities ... {{(pid=75562) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:54:04 devstack cinder-volume[75562]: INFO cinder.volume.manager [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Driver initialization completed successfully. Sep 28 18:54:04 devstack cinder-volume[75562]: INFO cinder.manager [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Initiating service 2 cleanup Sep 28 18:54:04 devstack cinder-volume[75562]: INFO cinder.manager [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Service 2 cleanup completed. Sep 28 18:54:04 devstack cinder-volume[75562]: DEBUG cinder.service [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Creating RPC server for service cinder-volume {{(pid=75562) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:54:04 devstack cinder-volume[75562]: DEBUG cinder.service [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75562) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:54:04 devstack cinder-volume[75562]: INFO cinder.volume.manager [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 18:54:04 devstack cinder-volume[75562]: DEBUG cinder.volume.drivers.lvm [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Updating volume stats {{(pid=75562) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:54:04 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:04 devstack sudo[76409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:54:04 devstack sudo[76409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:05 devstack sudo[76409]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:05 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:05 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:05 devstack sudo[76415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:54:05 devstack sudo[76415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:05 devstack sudo[76415]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:05 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:05 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:05 devstack sudo[76418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:54:05 devstack sudo[76418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:05 devstack sudo[76418]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:05 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:05 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:54:05 devstack sudo[76421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:54:05 devstack sudo[76421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:54:05 devstack sudo[76421]: pam_unix(sudo:session): session closed for user root Sep 28 18:54:05 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:54:06 devstack cinder-volume[75562]: INFO cinder.volume.manager [None req-18fdd098-455e-4b4b-ac50-9a568630d04f None None] Driver post RPC initialization completed successfully. Sep 28 18:54:07 devstack cinder-volume[75385]: DEBUG dbcounter [-] [75385] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:54:15 devstack cinder-volume[75562]: DEBUG dbcounter [-] [75562] Writing DB stats cinder:SELECT=4 {{(pid=75562) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:54:16 devstack cinder-volume[75562]: DEBUG dbcounter [-] [75562] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75562) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:54:31 devstack cinder-volume[75562]: DEBUG oslo_service.periodic_task [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running periodic task VolumeManager._thread_info {{(pid=75562) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:54:31 devstack cinder-volume[75562]: DEBUG cinder.volume.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] thread count: 6 {{(pid=75562) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:54:31 devstack cinder-volume[75562]: DEBUG cinder.volume.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] thread info: [<_MainThread(MainThread, started 129599488577664)>, , , , , ] {{(pid=75562) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:55:31 devstack cinder-volume[75562]: DEBUG oslo_service.periodic_task [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75562) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:55:31 devstack cinder-volume[75562]: DEBUG cinder.volume.drivers.lvm [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Updating volume stats {{(pid=75562) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:55:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:55:31 devstack sudo[79374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:55:31 devstack sudo[79374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:55:31 devstack sudo[79374]: pam_unix(sudo:session): session closed for user root Sep 28 18:55:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:55:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:55:31 devstack sudo[79377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:55:31 devstack sudo[79377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:55:31 devstack sudo[79377]: pam_unix(sudo:session): session closed for user root Sep 28 18:55:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:55:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:55:31 devstack sudo[79380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:55:31 devstack sudo[79380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:55:31 devstack sudo[79380]: pam_unix(sudo:session): session closed for user root Sep 28 18:55:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:55:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:55:31 devstack sudo[79383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:55:31 devstack sudo[79383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:55:32 devstack sudo[79383]: pam_unix(sudo:session): session closed for user root Sep 28 18:55:32 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:55:32 devstack cinder-volume[75562]: DEBUG cinder.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Notifying Schedulers of capabilities ... {{(pid=75562) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:55:32 devstack cinder-volume[75562]: DEBUG oslo_service.periodic_task [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running periodic task VolumeManager._thread_info {{(pid=75562) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:55:32 devstack cinder-volume[75562]: DEBUG cinder.volume.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] thread count: 6 {{(pid=75562) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:55:32 devstack cinder-volume[75562]: DEBUG cinder.volume.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] thread info: [<_MainThread(MainThread, started 129599488577664)>, , , , , ] {{(pid=75562) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:56:16 devstack cinder-volume[75562]: DEBUG dbcounter [-] [75562] Writing DB stats cinder:SELECT=1 {{(pid=75562) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:56:16 devstack cinder-volume[75562]: DEBUG dbcounter [-] [75562] Writing DB stats cinder:UPDATE=1 {{(pid=75562) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:56:31 devstack cinder-volume[75562]: DEBUG oslo_service.periodic_task [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75562) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:56:31 devstack cinder-volume[75562]: DEBUG cinder.volume.drivers.lvm [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Updating volume stats {{(pid=75562) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:56:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:56:31 devstack sudo[82989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:56:31 devstack sudo[82989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:56:31 devstack sudo[82989]: pam_unix(sudo:session): session closed for user root Sep 28 18:56:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:56:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:56:31 devstack sudo[82992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:56:31 devstack sudo[82992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:56:31 devstack sudo[82992]: pam_unix(sudo:session): session closed for user root Sep 28 18:56:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:56:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:56:31 devstack sudo[83042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:56:31 devstack sudo[83042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:56:31 devstack sudo[83042]: pam_unix(sudo:session): session closed for user root Sep 28 18:56:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:56:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:56:31 devstack sudo[83060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:56:31 devstack sudo[83060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:56:32 devstack sudo[83060]: pam_unix(sudo:session): session closed for user root Sep 28 18:56:32 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:56:32 devstack cinder-volume[75562]: DEBUG cinder.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Notifying Schedulers of capabilities ... {{(pid=75562) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:56:32 devstack cinder-volume[75562]: DEBUG oslo_service.periodic_task [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running periodic task VolumeManager._thread_info {{(pid=75562) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:56:32 devstack cinder-volume[75562]: DEBUG cinder.volume.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] thread count: 6 {{(pid=75562) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:56:32 devstack cinder-volume[75562]: DEBUG cinder.volume.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] thread info: [<_MainThread(MainThread, started 129599488577664)>, , , , , ] {{(pid=75562) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:57:31 devstack cinder-volume[75562]: DEBUG oslo_service.periodic_task [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75562) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:57:31 devstack cinder-volume[75562]: DEBUG cinder.volume.drivers.lvm [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Updating volume stats {{(pid=75562) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:57:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:57:31 devstack sudo[84606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:57:31 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:57:31 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root Sep 28 18:57:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:57:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:57:31 devstack sudo[84609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:57:31 devstack sudo[84609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:57:31 devstack sudo[84609]: pam_unix(sudo:session): session closed for user root Sep 28 18:57:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:57:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:57:31 devstack sudo[84613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:57:31 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:57:31 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root Sep 28 18:57:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:57:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:57:31 devstack sudo[84638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:57:31 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:57:32 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root Sep 28 18:57:32 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:57:32 devstack cinder-volume[75562]: DEBUG cinder.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Notifying Schedulers of capabilities ... {{(pid=75562) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:57:32 devstack cinder-volume[75562]: DEBUG oslo_service.periodic_task [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running periodic task VolumeManager._thread_info {{(pid=75562) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:57:32 devstack cinder-volume[75562]: DEBUG cinder.volume.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] thread count: 6 {{(pid=75562) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:57:32 devstack cinder-volume[75562]: DEBUG cinder.volume.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] thread info: [<_MainThread(MainThread, started 129599488577664)>, , , , , ] {{(pid=75562) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:58:16 devstack cinder-volume[75562]: DEBUG dbcounter [-] [75562] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75562) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:58:31 devstack cinder-volume[75562]: DEBUG oslo_service.periodic_task [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75562) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:58:31 devstack cinder-volume[75562]: DEBUG cinder.volume.drivers.lvm [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Updating volume stats {{(pid=75562) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:58:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:31 devstack sudo[85653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:58:31 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:31 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:31 devstack sudo[85656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:58:31 devstack sudo[85656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:31 devstack sudo[85656]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:31 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:58:31 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:31 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:31 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:31 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:58:31 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:32 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:32 devstack cinder-volume[75562]: DEBUG oslo_concurrency.processutils [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75562) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:32 devstack cinder-volume[75562]: DEBUG cinder.manager [None req-a0b5edc2-e8b1-4d75-859b-fe6ab210e7ae None None] Notifying Schedulers of capabilities ... {{(pid=75562) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:58:36 devstack cinder-volume[75385]: INFO oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Caught SIGTERM, stopping children Sep 28 18:58:36 devstack cinder-volume[75385]: DEBUG oslo_concurrency.lockutils [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Acquiring lock "singleton_lock" {{(pid=75385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:58:36 devstack cinder-volume[75385]: DEBUG oslo_concurrency.lockutils [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Acquired lock "singleton_lock" {{(pid=75385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:58:36 devstack cinder-volume[75385]: DEBUG oslo_concurrency.lockutils [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Releasing lock "singleton_lock" {{(pid=75385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:58:36 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Stop services. {{(pid=75385) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 18:58:36 devstack cinder-volume[75385]: DEBUG oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Killing children. {{(pid=75385) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 18:58:36 devstack cinder-volume[75385]: INFO oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Waiting on 1 children to exit Sep 28 18:58:39 devstack cinder-volume[75562]: DEBUG oslo_concurrency.lockutils [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Acquiring lock "singleton_lock" {{(pid=75562) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:58:39 devstack cinder-volume[75562]: DEBUG oslo_concurrency.lockutils [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Acquired lock "singleton_lock" {{(pid=75562) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:58:39 devstack cinder-volume[75562]: DEBUG oslo_concurrency.lockutils [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Releasing lock "singleton_lock" {{(pid=75562) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:58:39 devstack cinder-volume[75562]: WARNING amqp [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:58:39 devstack cinder-volume[75562]: WARNING amqp [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:58:39 devstack cinder-volume[75385]: INFO oslo_service.backend._eventlet.service [None req-8c563916-66bc-4fb8-85aa-2f865db8cdc3 None None] Child 75562 exited with status 0 Sep 28 18:58:40 devstack cinder-volume[85942]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:58:40 devstack cinder-volume[85942]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:58:40 devstack cinder-volume[85942]: we strongly recommend against using it for new projects. Sep 28 18:58:40 devstack cinder-volume[85942]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:58:40 devstack cinder-volume[85942]: framework. For more detail see Sep 28 18:58:40 devstack cinder-volume[85942]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:58:40 devstack cinder-volume[85942]: import eventlet # noqa Sep 28 18:58:42 devstack cinder-volume[85942]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:58:42 devstack cinder-volume[85942]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:58:42 devstack cinder-volume[85942]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:58:43 devstack cinder-volume[85942]: INFO dbcounter [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Registered counter for database cinder Sep 28 18:58:43 devstack cinder-volume[85942]: DEBUG oslo_db.sqlalchemy.engines [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85942) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:58:43 devstack cinder-volume[85942]: DEBUG dbcounter [-] [85942] Writer thread running {{(pid=85942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:58:43 devstack cinder-volume[85942]: INFO cinder.rpc [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:58:43 devstack cinder-volume[85942]: INFO cinder.rpc [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:58:43 devstack cinder-volume[85942]: DEBUG oslo_db.sqlalchemy.engines [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85942) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:58:43 devstack cinder-volume[85942]: INFO cinder.volume.manager [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Determined volume DB was empty at startup. Sep 28 18:58:43 devstack cinder-volume[85942]: DEBUG cinder.volume.manager [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85942) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:58:43 devstack cinder-volume[85942]: INFO cinder.volume.manager [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 18:58:43 devstack cinder-volume[85942]: WARNING stevedore.named [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:58:43 devstack cinder-volume[85942]: WARNING castellan.key_manager [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:58:43 devstack cinder-volume[85942]: WARNING cinder.keymgr.conf_key_mgr [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:58:43 devstack cinder-volume[85942]: INFO cinder.volume.manager [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_db.sqlalchemy.engines [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85942) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:58:44 devstack cinder-volume[85942]: INFO oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Starting 1 workers Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Started child 86207 {{(pid=85942) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Full set of CONF: {{(pid=85942) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] ******************************************************************************** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Configuration options gathered from: {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] ================================================================================ {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:58:44 devstack cinder-volume[86207]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] allow_availability_zone_fallback = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] allow_compression_on_image_upload = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] allowed_direct_url_schemes = [] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] api_rate_limit = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] auth_strategy = keystone {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_availability_zone = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_host = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_name = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_stats_polling_interval = 60 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backup_api_class = cinder.backup.api.API {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backup_name_template = backup-%s {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backup_use_same_host = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backup_use_temp_snapshot = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] chap_password = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] chap_username = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cinder_internal_tenant_project_id = 26cde7cd9a0a4e169d97266ff4734055 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cinder_internal_tenant_user_id = bffe35ad3a244b1599d8d46ce74a6b3e {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cluster = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] compression_format = gzip {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] compute_api_class = cinder.compute.nova.API {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] config_dir = [] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] config_source = [] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] control_exchange = openstack {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] debug = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] default_availability_zone = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] default_group_type = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] default_volume_type = QuobyteHD {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] disk_geometry = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] driver_client_cert = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] driver_client_cert_key = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] driver_data_namespace = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] driver_ssl_cert_path = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] driver_ssl_cert_verify = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] driver_use_ssl = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] enable_new_services = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] enable_unsupported_driver = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] enabled_backends = ['QuobyteHD'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] enforce_multipath_for_image_xfer = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] filter_function = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance_api_insecure = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance_api_servers = ['http://192.168.122.215/image'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance_api_ssl_compression = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance_ca_certificates_file = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance_catalog_info = image:glance:publicURL {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance_certfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance_keyfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance_num_retries = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance_request_timeout = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] goodness_function = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] graceful_shutdown_timeout = 5 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] group_api_class = cinder.group.api.API {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] host = devstack {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_compress_on_upload = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_conversion_address_space_limit = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_conversion_cpu_limit = 60 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_conversion_disable = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_introspection_address_space_limit = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_introspection_cpu_limit = 60 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_upload_use_cinder_backend = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_upload_use_internal_tenant = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_volume_cache_enabled = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_volume_cache_max_count = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] image_volume_cache_max_size_gb = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] init_host_max_objects_retrieval = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] instance_format = [instance: %(uuid)s] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] iscsi_target_flags = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] iscsi_write_cache = on {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] iser_helper = tgtadm {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] iser_ip_address = 192.168.122.215 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] iser_port = 3260 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] log_color = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] log_config_append = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] log_dir = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] log_file = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] log_options = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] log_rotate_interval = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[86207]: INFO cinder.volume.manager [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.remotefs [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86207) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] log_rotate_interval_type = days {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] log_rotation_type = none {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] max_age = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] max_logfile_count = 30 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] max_logfile_size_mb = 200 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] max_over_subscription_ratio = 20.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] message_reap_interval = 86400 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] message_ttl = 2592000 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] migration_create_volume_timeout_secs = 300 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] monkey_patch = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] monkey_patch_modules = [] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] my_ip = 192.168.122.215 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] no_snapshot_gb_quota = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] num_iser_scan_tries = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] num_shell_tries = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] num_volume_device_scan_tries = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] nvmeof_conn_info_version = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] nvmet_ns_id = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] nvmet_port_id = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] osapi_max_limit = 1000 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] osapi_volume_ext_list = [] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] osapi_volume_listen_port = 8776 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] osapi_volume_use_ssl = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] osapi_volume_workers = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] per_volume_size_limit = -1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] periodic_fuzzy_delay = 60 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] periodic_interval = 60 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] public_endpoint = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] publish_errors = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] quota_backup_gigabytes = 1000 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] quota_backups = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] quota_gigabytes = 1000 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] quota_groups = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] quota_snapshots = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] quota_volumes = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] rate_limit_burst = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] rate_limit_except_level = CRITICAL {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] rate_limit_interval = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] reinit_driver_count = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] replication_device = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] report_discard_supported = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] report_interval = 120 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] reservation_clean_interval = 86400 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] reservation_expire = 86400 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] reserved_image_namespaces = [] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] reserved_percentage = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] rpc_response_timeout = 120 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] run_external_periodic_tasks = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] scst_target_driver = iscsi {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] scst_target_iqn_name = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_down_time = 720 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] shell_completion = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] snapshot_name_template = snapshot-%s {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] split_loggers = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] state_path = /opt/stack/data/cinder {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] storage_availability_zone = nova {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] storage_protocol = iSCSI {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] syslog_log_facility = LOG_USER {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] target_helper = lioadm {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] target_ip_address = 192.168.122.215 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] target_port = 3260 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] target_protocol = iscsi {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] target_secondary_ip_addresses = [] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] trace_flags = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] transport_url = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] until_refresh = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] use_chap_auth = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] use_default_quota_class = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] use_journal = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] use_json = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] use_multipath_for_image_xfer = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] use_stderr = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] use_syslog = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] verify_glance_signatures = enabled {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_api_class = cinder.volume.api.API {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_backend_name = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_clear = zero {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_clear_ionice = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_clear_size = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_copy_bps_limit = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_dd_blocksize = 1M {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_name_template = volume-%s {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_service_inithost_offload = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volume_usage_audit_period = month {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] zoning_mode = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_concurrency.disable_process_locking = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.auth_section = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.auth_type = password {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.auth_version = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.cache = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86207) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.certfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[86207]: WARNING cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.include_service_catalog = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.insecure = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.interface = public {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[86207]: WARNING cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.keyfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_password = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Running cmd (subprocess): mount.quobyte {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcache_username = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.region_name = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.service_type = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.215/identity {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.backend = dogpile.cache.null {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.backend_argument = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.backend_expiration_time = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.config_prefix = cache.oslo {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.debug_cache_backend = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.enable_retry_client = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.enable_socket_keepalive = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.enabled = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.expiration_time = 600 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.hashclient_retry_attempts = 2 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.memcache_dead_retry = 300 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.memcache_pool_maxsize = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.memcache_sasl_enabled = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.password = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.proxies = [] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.redis_db = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.redis_server = localhost:6379 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.retry_attempts = 2 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.retry_delay = 0.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.socket_keepalive_count = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.socket_keepalive_idle = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.socket_keepalive_interval = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.socket_timeout = 1.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.tls_allowed_ciphers = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.tls_cafile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.tls_certfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.tls_enabled = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.tls_keyfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cache.username = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] coordination.backend_url = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.asyncio_connection = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.asyncio_slave_connection = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.backend = sqlalchemy {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.connection = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.connection_debug = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.connection_parameters = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.connection_recycle_time = 3600 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.connection_trace = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.db_inc_retry_interval = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.db_max_retries = 20 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.db_max_retry_interval = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.db_retry_interval = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.max_overflow = 50 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.max_pool_size = 5 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.max_retries = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.mysql_wsrep_sync_wait = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.pool_timeout = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.retry_interval = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.slave_connection = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.sqlite_synchronous = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.synchronous_reader = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] database.use_db_reconnect = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_tracing.insecure = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.connection_string = messaging:// {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.enabled = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.es_doc_type = notification {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.es_scroll_size = 10000 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.es_scroll_time = 2m {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.filter_error_trace = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.hmac_keys = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.sentinel_service_name = mymaster {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.socket_timeout = 0.1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.trace_requests = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler.trace_sqlalchemy = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler_jaeger.process_tags = {} {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler_jaeger.service_name_prefix = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] profiler_otlp.service_name_prefix = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_policy.enforce_new_defaults = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_policy.policy_default_rule = default {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_policy.policy_file = policy.yaml {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] privsep_osbrick.group = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] privsep_osbrick.helper_command = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] privsep_osbrick.user = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cinder_sys_admin.group = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cinder_sys_admin.helper_command = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] cinder_sys_admin.user = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.auth_section = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.auth_type = password {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.cafile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.certfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.collect_timing = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.insecure = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.keyfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.send_service_user_token = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.split_loggers = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.timeout = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.tls_ciphers = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] service_user.tls_min_version = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.auth_section = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.auth_type = password {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.certfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.collect_timing = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.insecure = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.keyfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.region_name = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.split_loggers = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.timeout = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.tls_ciphers = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] glance.tls_min_version = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.backend_availability_zone = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.chap_password = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.chap_username = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.disk_geometry = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.driver_client_cert = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.driver_client_cert_key = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.driver_data_namespace = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.driver_use_ssl = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.extra_capabilities = {} {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.filter_function = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.goodness_function = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.iscsi_target_flags = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.iscsi_write_cache = on {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.iser_helper = tgtadm {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.iser_ip_address = 192.168.122.215 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.iser_port = 3260 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nas_host = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nas_login = admin {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nas_mount_options = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nas_password = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nas_private_key = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nas_share_path = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack quobyte-client[86210]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 18:58:44 devstack quobyte-client[86210]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.num_shell_tries = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:58:44 devstack cinder-volume[86207]: INFO cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca ... Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d -c /etc/quobyte/client-cinder.cfg {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.quobyte_volume_url = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.replication_device = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.report_discard_supported = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.reserved_percentage = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.target_helper = tgtadm {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.target_ip_address = 192.168.122.215 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.target_port = 3260 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.target_protocol = iscsi {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.trace_flags = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.unique_fqdn_network = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.use_chap_auth = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.volume_backend_name = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.volume_clear = zero {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.volume_clear_ionice = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.volume_clear_size = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_reports.file_event_handler = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_reports.log_dir = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.backend_availability_zone = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.backend_host = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.chap_password = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.chap_username = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.chiscsi_conf = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.disk_geometry = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.driver_client_cert = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.driver_data_namespace = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.driver_use_ssl = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.extra_capabilities = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.filter_function = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.goodness_function = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d -c /etc/quobyte/client-cinder.cfg Sep 28 18:58:44 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.iser_helper = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.iser_ip_address = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.iser_port = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.iser_target_prefix = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nas_host = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nas_login = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nas_mount_options = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nas_password = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nas_private_key = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nas_share_path = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nas_ssh_port = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.num_shell_tries = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.nvmet_port_id = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.replication_device = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.report_discard_supported = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.reserved_percentage = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.scst_target_driver = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.storage_protocol = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.target_helper = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.target_ip_address = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.target_port = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.target_prefix = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.target_protocol = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.trace_flags = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.use_chap_auth = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.volume_clear = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.volume_clear_size = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] QuobyteHD.volumes_dir = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.ssl = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_notifications.driver = [] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_notifications.retry = -1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] key_manager.fixed_key = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.barbican_api_version = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.barbican_endpoint = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.barbican_endpoint_type = public {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.barbican_region_name = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.cafile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.certfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.collect_timing = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.insecure = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.keyfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.number_of_retries = 60 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.retry_delay = 1 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.send_service_user_token = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.split_loggers = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.timeout = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.tls_ciphers = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.tls_min_version = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.verify_ssl = True {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican.verify_ssl_path = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.auth_section = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.auth_type = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.cafile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.certfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.collect_timing = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.insecure = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.keyfile = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.split_loggers = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.timeout = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.tls_ciphers = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] barbican_service_user.tls_min_version = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.approle_role_id = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.approle_secret_id = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.auth_method = approle {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.auth_path = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.kv_mountpoint = secret {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.kv_path = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.kv_version = 2 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.namespace = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.root_token_id = **** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.ssl_ca_crt_file = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.timeout = 60.0 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.token_file = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.token_role = None {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.use_ssl = False {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:44 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] ******************************************************************************** {{(pid=85942) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:58:44 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.476s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:44 devstack cinder-volume[86207]: INFO cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca succeeded Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.500s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:58:44 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:44 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 18:58:44 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:45 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.266s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:45 devstack cinder-volume[86207]: INFO cinder.volume.driver [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG cinder.volume.driver [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0996932983398, 'free_capacity_gb': 1775.0996932983398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86207) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_db.sqlalchemy.engines [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG dbcounter [-] [86207] Writer thread running {{(pid=86207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG cinder.db.api [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Building query based on filter {{(pid=86207) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG cinder.image.image_utils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86207) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:58:45 devstack cinder-volume[86207]: INFO cinder.keymgr.migration [None req-eea255b8-0aa6-482b-85a1-8c5c147c69fe None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:45 devstack sudo[86331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 18:58:45 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:45 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.256s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG cinder.manager [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Notifying Schedulers of capabilities ... {{(pid=86207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:58:45 devstack cinder-volume[86207]: INFO cinder.volume.manager [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Driver initialization completed successfully. Sep 28 18:58:45 devstack cinder-volume[86207]: INFO cinder.manager [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Initiating service 3 cleanup Sep 28 18:58:45 devstack cinder-volume[86207]: INFO cinder.manager [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Service 3 cleanup completed. Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG cinder.service [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Creating RPC server for service cinder-volume {{(pid=86207) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG cinder.service [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86207) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:58:45 devstack cinder-volume[86207]: INFO cinder.volume.manager [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:58:45 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:45 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 18:58:45 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:46 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:46 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.308s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:46 devstack cinder-volume[86207]: INFO cinder.volume.manager [None req-b43946b5-412c-48a5-bef1-9e45262256da None None] Driver post RPC initialization completed successfully. Sep 28 18:58:49 devstack cinder-volume[85942]: INFO oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Caught SIGTERM, stopping children Sep 28 18:58:49 devstack cinder-volume[85942]: DEBUG oslo_concurrency.lockutils [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Acquiring lock "singleton_lock" {{(pid=85942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:58:49 devstack cinder-volume[85942]: DEBUG oslo_concurrency.lockutils [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Acquired lock "singleton_lock" {{(pid=85942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:58:49 devstack cinder-volume[85942]: DEBUG oslo_concurrency.lockutils [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Releasing lock "singleton_lock" {{(pid=85942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:58:49 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Stop services. {{(pid=85942) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 18:58:49 devstack cinder-volume[85942]: DEBUG oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Killing children. {{(pid=85942) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 18:58:49 devstack cinder-volume[85942]: INFO oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Waiting on 1 children to exit Sep 28 18:58:49 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Acquiring lock "singleton_lock" {{(pid=86207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:58:49 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Acquired lock "singleton_lock" {{(pid=86207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:58:49 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Releasing lock "singleton_lock" {{(pid=86207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:58:49 devstack cinder-volume[86207]: WARNING amqp [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:58:49 devstack cinder-volume[86207]: WARNING amqp [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:58:49 devstack cinder-volume[85942]: INFO oslo_service.backend._eventlet.service [None req-24707111-1854-4773-bfdf-6c0670618e25 None None] Child 86207 exited with status 0 Sep 28 18:58:50 devstack cinder-volume[86579]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:58:50 devstack cinder-volume[86579]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:58:50 devstack cinder-volume[86579]: we strongly recommend against using it for new projects. Sep 28 18:58:50 devstack cinder-volume[86579]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:58:50 devstack cinder-volume[86579]: framework. For more detail see Sep 28 18:58:50 devstack cinder-volume[86579]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:58:50 devstack cinder-volume[86579]: import eventlet # noqa Sep 28 18:58:53 devstack cinder-volume[86579]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:58:53 devstack cinder-volume[86579]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:58:53 devstack cinder-volume[86579]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:58:54 devstack cinder-volume[86579]: INFO dbcounter [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Registered counter for database cinder Sep 28 18:58:54 devstack cinder-volume[86579]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:58:54 devstack cinder-volume[86579]: DEBUG dbcounter [-] [86579] Writer thread running {{(pid=86579) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:58:54 devstack cinder-volume[86579]: INFO cinder.rpc [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:58:54 devstack cinder-volume[86579]: INFO cinder.rpc [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:58:54 devstack cinder-volume[86579]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:58:55 devstack cinder-volume[86579]: INFO cinder.volume.manager [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Determined volume DB was empty at startup. Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG cinder.volume.manager [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86579) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:58:55 devstack cinder-volume[86579]: WARNING stevedore.named [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:58:55 devstack cinder-volume[86579]: WARNING castellan.key_manager [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:58:55 devstack cinder-volume[86579]: WARNING cinder.keymgr.conf_key_mgr [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:58:55 devstack cinder-volume[86579]: INFO cinder.volume.manager [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:58:55 devstack cinder-volume[86579]: INFO oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Starting 1 workers Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Started child 86846 {{(pid=86579) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Full set of CONF: {{(pid=86579) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] ******************************************************************************** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] Configuration options gathered from: {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] ================================================================================ {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] allow_availability_zone_fallback = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] allow_compression_on_image_upload = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] allowed_direct_url_schemes = [] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86846]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] api_rate_limit = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] auth_strategy = keystone {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_availability_zone = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_host = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_name = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_stats_polling_interval = 60 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backup_api_class = cinder.backup.api.API {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backup_name_template = backup-%s {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backup_use_same_host = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backup_use_temp_snapshot = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] chap_password = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] chap_username = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cinder_internal_tenant_project_id = 26cde7cd9a0a4e169d97266ff4734055 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cinder_internal_tenant_user_id = bffe35ad3a244b1599d8d46ce74a6b3e {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cluster = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] compression_format = gzip {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] compute_api_class = cinder.compute.nova.API {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] config_dir = [] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] config_source = [] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] control_exchange = openstack {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] debug = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] default_availability_zone = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] default_group_type = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] default_volume_type = QuobyteHD {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] disk_geometry = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] driver_client_cert = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] driver_client_cert_key = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] driver_data_namespace = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] driver_ssl_cert_path = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] driver_ssl_cert_verify = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] driver_use_ssl = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] enable_new_services = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] enable_unsupported_driver = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] enabled_backends = ['QuobyteHD'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] enforce_multipath_for_image_xfer = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] filter_function = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance_api_insecure = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance_api_servers = ['http://192.168.122.215/image'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance_api_ssl_compression = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance_ca_certificates_file = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance_catalog_info = image:glance:publicURL {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance_certfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance_keyfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance_num_retries = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance_request_timeout = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] goodness_function = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] graceful_shutdown_timeout = 5 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] group_api_class = cinder.group.api.API {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] host = devstack {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_compress_on_upload = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_conversion_address_space_limit = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_conversion_cpu_limit = 60 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_conversion_disable = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_introspection_address_space_limit = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_introspection_cpu_limit = 60 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_upload_use_cinder_backend = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_upload_use_internal_tenant = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_volume_cache_enabled = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_volume_cache_max_count = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] image_volume_cache_max_size_gb = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] init_host_max_objects_retrieval = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] instance_format = [instance: %(uuid)s] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] iscsi_target_flags = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] iscsi_write_cache = on {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] iser_helper = tgtadm {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] iser_ip_address = 192.168.122.215 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] iser_port = 3260 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] log_color = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] log_config_append = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] log_dir = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] log_file = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] log_options = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] log_rotate_interval = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] log_rotate_interval_type = days {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] log_rotation_type = none {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] max_age = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] max_logfile_count = 30 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] max_logfile_size_mb = 200 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] max_over_subscription_ratio = 20.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] message_reap_interval = 86400 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] message_ttl = 2592000 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] migration_create_volume_timeout_secs = 300 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] monkey_patch = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] monkey_patch_modules = [] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] my_ip = 192.168.122.215 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] no_snapshot_gb_quota = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] num_iser_scan_tries = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] num_shell_tries = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] num_volume_device_scan_tries = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] nvmeof_conn_info_version = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] nvmet_ns_id = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] nvmet_port_id = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] osapi_max_limit = 1000 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] osapi_volume_ext_list = [] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] osapi_volume_listen_port = 8776 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] osapi_volume_use_ssl = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] osapi_volume_workers = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] per_volume_size_limit = -1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] periodic_fuzzy_delay = 60 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] periodic_interval = 60 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] public_endpoint = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] publish_errors = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] quota_backup_gigabytes = 1000 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] quota_backups = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] quota_gigabytes = 1000 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] quota_groups = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] quota_snapshots = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] quota_volumes = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] rate_limit_burst = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] rate_limit_except_level = CRITICAL {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] rate_limit_interval = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] reinit_driver_count = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] replication_device = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] report_discard_supported = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] report_interval = 120 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] reservation_clean_interval = 86400 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] reservation_expire = 86400 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] reserved_image_namespaces = [] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] reserved_percentage = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] rpc_response_timeout = 120 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] run_external_periodic_tasks = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] scst_target_driver = iscsi {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] scst_target_iqn_name = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_down_time = 720 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] shell_completion = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] snapshot_name_template = snapshot-%s {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] split_loggers = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] state_path = /opt/stack/data/cinder {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] storage_availability_zone = nova {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] storage_protocol = iSCSI {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] syslog_log_facility = LOG_USER {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] target_helper = lioadm {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] target_ip_address = 192.168.122.215 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] target_port = 3260 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] target_protocol = iscsi {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] target_secondary_ip_addresses = [] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] trace_flags = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] transport_url = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] until_refresh = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] use_chap_auth = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] use_default_quota_class = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] use_journal = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] use_json = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] use_multipath_for_image_xfer = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] use_stderr = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] use_syslog = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] verify_glance_signatures = enabled {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_api_class = cinder.volume.api.API {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_backend_name = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_clear = zero {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_clear_ionice = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_clear_size = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_copy_bps_limit = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_dd_blocksize = 1M {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_name_template = volume-%s {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_service_inithost_offload = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volume_usage_audit_period = month {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] zoning_mode = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_concurrency.disable_process_locking = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.auth_section = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.auth_type = password {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.auth_version = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-50a57322-3587-42ba-80dd-681051f78504 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86846) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.cache = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.certfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.include_service_catalog = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.insecure = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.interface = public {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.keyfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_password = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcache_username = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.region_name = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.service_type = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.215/identity {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.backend = dogpile.cache.null {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.backend_argument = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.backend_expiration_time = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.config_prefix = cache.oslo {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.debug_cache_backend = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.enable_retry_client = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.enable_socket_keepalive = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.enabled = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.expiration_time = 600 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.hashclient_retry_attempts = 2 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.memcache_dead_retry = 300 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.memcache_pool_maxsize = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.memcache_sasl_enabled = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.password = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.proxies = [] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.redis_db = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.redis_server = localhost:6379 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.retry_attempts = 2 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.retry_delay = 0.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.socket_keepalive_count = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.socket_keepalive_idle = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.socket_keepalive_interval = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.socket_timeout = 1.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.tls_allowed_ciphers = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.tls_cafile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.tls_certfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.tls_enabled = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.tls_keyfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cache.username = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] coordination.backend_url = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.asyncio_connection = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.asyncio_slave_connection = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.backend = sqlalchemy {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.connection = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.connection_debug = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.connection_parameters = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.connection_recycle_time = 3600 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.connection_trace = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.db_inc_retry_interval = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.db_max_retries = 20 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.db_max_retry_interval = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.db_retry_interval = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.max_overflow = 50 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.max_pool_size = 5 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.max_retries = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.mysql_wsrep_sync_wait = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.pool_timeout = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.retry_interval = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.slave_connection = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.sqlite_synchronous = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.synchronous_reader = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] database.use_db_reconnect = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_tracing.insecure = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.connection_string = messaging:// {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.enabled = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.es_doc_type = notification {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.es_scroll_size = 10000 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.es_scroll_time = 2m {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.filter_error_trace = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.hmac_keys = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.sentinel_service_name = mymaster {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.socket_timeout = 0.1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.trace_requests = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler.trace_sqlalchemy = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler_jaeger.process_tags = {} {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler_jaeger.service_name_prefix = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] profiler_otlp.service_name_prefix = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_policy.enforce_new_defaults = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_policy.policy_default_rule = default {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_policy.policy_file = policy.yaml {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] privsep_osbrick.group = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] privsep_osbrick.helper_command = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] privsep_osbrick.user = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cinder_sys_admin.group = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cinder_sys_admin.helper_command = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] cinder_sys_admin.user = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.auth_section = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.auth_type = password {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.cafile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.certfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.collect_timing = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.insecure = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.keyfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.send_service_user_token = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.split_loggers = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.timeout = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.tls_ciphers = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] service_user.tls_min_version = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.auth_section = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.auth_type = password {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.certfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.collect_timing = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.insecure = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.keyfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.region_name = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.split_loggers = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.timeout = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.tls_ciphers = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] glance.tls_min_version = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.backend_availability_zone = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.chap_password = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.chap_username = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.disk_geometry = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.driver_client_cert = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.driver_client_cert_key = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.driver_data_namespace = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.driver_use_ssl = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.extra_capabilities = {} {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.filter_function = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.goodness_function = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50a57322-3587-42ba-80dd-681051f78504 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86846) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 18:58:55 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.quobyte [None req-50a57322-3587-42ba-80dd-681051f78504 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 18:58:55 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.quobyte [None req-50a57322-3587-42ba-80dd-681051f78504 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.iscsi_target_flags = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.iscsi_write_cache = on {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Running cmd (subprocess): mount.quobyte {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.iser_helper = tgtadm {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.iser_ip_address = 192.168.122.215 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.iser_port = 3260 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nas_host = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nas_login = admin {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nas_mount_options = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nas_password = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nas_private_key = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nas_share_path = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.num_shell_tries = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.quobyte_volume_url = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.replication_device = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.report_discard_supported = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.reserved_percentage = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.target_helper = tgtadm {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.target_ip_address = 192.168.122.215 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.target_port = 3260 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.target_protocol = iscsi {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.trace_flags = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.unique_fqdn_network = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.use_chap_auth = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.volume_backend_name = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.volume_clear = zero {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.volume_clear_ionice = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.volume_clear_size = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_reports.file_event_handler = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_reports.log_dir = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.backend_availability_zone = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.backend_host = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.chap_password = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.chap_username = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.chiscsi_conf = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.disk_geometry = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.driver_client_cert = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.driver_data_namespace = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.driver_use_ssl = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.extra_capabilities = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.filter_function = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.goodness_function = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.iser_helper = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.iser_ip_address = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.iser_port = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.iser_target_prefix = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nas_host = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nas_login = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nas_mount_options = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nas_password = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nas_private_key = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nas_share_path = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nas_ssh_port = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.num_shell_tries = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.nvmet_port_id = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.replication_device = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.report_discard_supported = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.reserved_percentage = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.scst_target_driver = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.storage_protocol = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.target_helper = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.target_ip_address = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.target_port = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.target_prefix = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.target_protocol = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack quobyte-client[86881]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.trace_flags = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.use_chap_auth = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack quobyte-client[86881]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.volume_clear = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.volume_clear_size = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] QuobyteHD.volumes_dir = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] CMD "mount.quobyte" returned: 1 in 0.137s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:58:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:58:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.ssl = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_notifications.driver = [] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_notifications.retry = -1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] key_manager.fixed_key = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.barbican_api_version = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.barbican_endpoint = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.barbican_endpoint_type = public {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.barbican_region_name = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.cafile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.certfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.collect_timing = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.insecure = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.keyfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.number_of_retries = 60 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.retry_delay = 1 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.send_service_user_token = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.split_loggers = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.timeout = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.tls_ciphers = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.tls_min_version = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.verify_ssl = True {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican.verify_ssl_path = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.auth_section = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.auth_type = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.cafile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.certfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.collect_timing = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.insecure = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.keyfile = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.split_loggers = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.timeout = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.tls_ciphers = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] barbican_service_user.tls_min_version = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.approle_role_id = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.approle_secret_id = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.auth_method = approle {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.auth_path = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.kv_mountpoint = secret {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.kv_path = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.kv_version = 2 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.namespace = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.root_token_id = **** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.ssl_ca_crt_file = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.timeout = 60.0 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.token_file = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.token_role = None {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.use_ssl = False {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:58:55 devstack cinder-volume[86579]: DEBUG oslo_service.backend._eventlet.service [None req-dcc4121b-a593-40c5-9068-e74c6d39b822 None None] ******************************************************************************** {{(pid=86579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:58:55 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 18:58:55 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:56 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.640s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:56 devstack cinder-volume[86846]: INFO cinder.volume.driver [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG cinder.volume.driver [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0996932983398, 'free_capacity_gb': 1775.0996932983398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86846) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG oslo_db.sqlalchemy.engines [None req-50a57322-3587-42ba-80dd-681051f78504 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writer thread running {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG cinder.db.api [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Building query based on filter {{(pid=86846) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86846) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:58:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:56 devstack cinder-volume[86846]: INFO cinder.keymgr.migration [None req-7ddb7c39-bb18-4ee9-b6ac-9497eb15de57 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:58:56 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 18:58:56 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:57 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.439s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:58:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Driver initialization completed successfully. Sep 28 18:58:57 devstack cinder-volume[86846]: INFO cinder.manager [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Initiating service 3 cleanup Sep 28 18:58:57 devstack cinder-volume[86846]: INFO cinder.manager [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Service 3 cleanup completed. Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG cinder.service [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Creating RPC server for service cinder-volume {{(pid=86846) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG cinder.service [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86846) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:58:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:58:57 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 18:58:57 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:58:57 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Sep 28 18:58:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50a57322-3587-42ba-80dd-681051f78504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.290s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:58:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-50a57322-3587-42ba-80dd-681051f78504 None None] Driver post RPC initialization completed successfully. Sep 28 18:59:05 devstack cinder-volume[86579]: DEBUG dbcounter [-] [86579] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86579) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:59:07 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:59:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:59:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 6 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:59:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:00:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:00:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:00:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:00:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:00:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:00:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:00:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:00:34 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:00:34 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:35 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.660s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:00:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:00:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:00:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 6 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:00:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Flow 'volume_create_manager' (1dc22ccd-c06d-4de9-9a72-e148ff1812a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e3dff3-c2a0-4f9a-a216-d7f7c4c2eee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e3dff3-c2a0-4f9a-a216-d7f7c4c2eee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1658797404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28aa0d18-bfc7-4d78-a5b6-976151533035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bbe30119704bf38aaee9c00fffd1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:00:40Z,use_quota=True,user_id='9e725d6289ea4f539ac73f0c15876326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c51f14c-8a12-4743-bd6f-87e26d1d6747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c51f14c-8a12-4743-bd6f-87e26d1d6747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a9d0bc-4d83-408a-87a2-afe2c35d88c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a9d0bc-4d83-408a-87a2-afe2c35d88c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28aa0d18-bfc7-4d78-a5b6-976151533035', 'volume_name': 'volume-28aa0d18-bfc7-4d78-a5b6-976151533035', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab43271-83d1-4bf8-8da4-c0056807bcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab43271-83d1-4bf8-8da4-c0056807bcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58250e9-b860-417d-b661-80c475b3ba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:40 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Volume 28aa0d18-bfc7-4d78-a5b6-976151533035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28aa0d18-bfc7-4d78-a5b6-976151533035', 'volume_size': 1} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1658797404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28aa0d18-bfc7-4d78-a5b6-976151533035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bbe30119704bf38aaee9c00fffd1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:00:40Z,use_quota=True,user_id='9e725d6289ea4f539ac73f0c15876326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Creating volume 28aa0d18-bfc7-4d78-a5b6-976151533035 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:00:40 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:00:40 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035 1073741824 Sep 28 19:00:40 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:42 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035 1073741824" returned: 0 in 2.052s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:00:42 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035 Sep 28 19:00:42 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:43 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035" returned: 0 in 0.607s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] <== create_volume: return (2824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.829s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58250e9-b860-417d-b661-80c475b3ba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28aa0d18-bfc7-4d78-a5b6-976151533035', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8f4124-ab45-4a66-8ac8-3d9e342c7f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Volume volume-28aa0d18-bfc7-4d78-a5b6-976151533035 (28aa0d18-bfc7-4d78-a5b6-976151533035): created successfully Sep 28 19:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8f4124-ab45-4a66-8ac8-3d9e342c7f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Flow 'volume_create_manager' (1dc22ccd-c06d-4de9-9a72-e148ff1812a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:00:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-17aa40ae-142d-485c-85ad-65a51bc913e5 tempest-VolumesAdminNegativeTest-231335091 None] Created volume successfully. Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Flow 'volume_create_manager' (895a24f6-012a-4f6c-b26c-5e573a0b55d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c593be-e51f-4565-b9c8-eb0e092625bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c593be-e51f-4565-b9c8-eb0e092625bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1994950249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b32757-f306-4529-892f-7e4be1c4d2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5aa4f35d61747a49a152340662a3a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:00:44Z,use_quota=True,user_id='2f0272e6309d4169ba084367fd22d7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed6e122-d4ef-44d1-b716-003087e79631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed6e122-d4ef-44d1-b716-003087e79631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4357fb-2548-4053-a662-831a7c6cfe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4357fb-2548-4053-a662-831a7c6cfe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b32757-f306-4529-892f-7e4be1c4d2b7', 'volume_name': 'volume-03b32757-f306-4529-892f-7e4be1c4d2b7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016a5a92-023d-493c-8c2f-e226e6d8a60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016a5a92-023d-493c-8c2f-e226e6d8a60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44dfdcd7-e905-4daf-a6c1-004766b28b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Volume 03b32757-f306-4529-892f-7e4be1c4d2b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b32757-f306-4529-892f-7e4be1c4d2b7', 'volume_size': 1} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1994950249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b32757-f306-4529-892f-7e4be1c4d2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5aa4f35d61747a49a152340662a3a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:00:44Z,use_quota=True,user_id='2f0272e6309d4169ba084367fd22d7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Creating volume 03b32757-f306-4529-892f-7e4be1c4d2b7 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:00:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:00:44 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7 1073741824 Sep 28 19:00:44 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Acquiring lock "cinder-28aa0d18-bfc7-4d78-a5b6-976151533035-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:00:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Lock "cinder-28aa0d18-bfc7-4d78-a5b6-976151533035-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:00:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Acquiring lock "cinder-quobyte-28aa0d18-bfc7-4d78-a5b6-976151533035" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:00:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Lock "cinder-quobyte-28aa0d18-bfc7-4d78-a5b6-976151533035" acquired by "delete_volume" :: waited 0.084s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:00:45 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsfbp4jx7/privsep.sock'] Sep 28 19:00:45 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsfbp4jx7/privsep.sock Sep 28 19:00:45 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:45 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7 1073741824" returned: 0 in 1.030s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:00:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:00:46 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7 Sep 28 19:00:46 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:46 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7" returned: 0 in 0.945s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:00:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:00:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44dfdcd7-e905-4daf-a6c1-004766b28b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b32757-f306-4529-892f-7e4be1c4d2b7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82eba937-f207-4598-a0a0-651190e22e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Volume volume-03b32757-f306-4529-892f-7e4be1c4d2b7 (03b32757-f306-4529-892f-7e4be1c4d2b7): created successfully Sep 28 19:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82eba937-f207-4598-a0a0-651190e22e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Flow 'volume_create_manager' (895a24f6-012a-4f6c-b26c-5e573a0b55d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:00:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-182c4f53-15ea-479d-b8e5-74f39edaaa9c tempest-ServerRescueNegativeTestJSON-1847309666 None] Created volume successfully. Sep 28 19:00:48 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 19:00:48 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 19:00:48 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 19:00:48 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 19:00:48 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 19:00:48 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 19:00:48 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 19:00:48 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 19:00:48 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 19:00:48 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:48 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Spawned new privsep daemon via rootwrap Sep 28 19:00:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Accepted privsep connection to /tmp/tmpsfbp4jx7/privsep.sock {{(pid=86846) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 19:00:48 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 19:00:48 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 19:00:48 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 19:00:48 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88332 Sep 28 19:00:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf57087-e2d5-4680-a5c7-3bc50ab2a893]: (2,) {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:00:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5725e6-ca57-4695-9cd7-f984eacb47a6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:00:48 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035 Sep 28 19:00:48 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:49 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035" returned: 0 in 1.453s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:00:50 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035 Sep 28 19:00:50 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:50 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28aa0d18-bfc7-4d78-a5b6-976151533035" returned: 0 in 0.795s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:00:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Lock "cinder-quobyte-28aa0d18-bfc7-4d78-a5b6-976151533035" released by "delete_volume" :: held 5.182s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:00:50 devstack cinder-volume[86846]: WARNING cinder.quota [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:00:50 devstack cinder-volume[86846]: WARNING cinder.quota [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:00:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Created reservations ['32e51c1d-beae-41e9-a717-43dcc43f393b', '4607a764-9556-4753-a7c1-6983dfd9e028', '1e3b714f-ad48-4777-8db6-302bc3906817', '94e1140e-dbdc-4734-9c6a-744d53b579be'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:00:51 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:00:51 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:52 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.783s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:00:52 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:00:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Deleted volume successfully. Sep 28 19:00:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a6a57030-d307-4da7-affa-ca0d7b0c3b5b tempest-VolumesAdminNegativeTest-231335091 None] Lock "cinder-28aa0d18-bfc7-4d78-a5b6-976151533035-delete_volume" released by "delete_volume" :: held 6.885s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Flow 'volume_create_manager' (d5395dc1-fc25-47ac-9f12-46dd455fec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3115f344-1b8a-4c1e-a1a4-42f29421526a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3115f344-1b8a-4c1e-a1a4-42f29421526a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1919003280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48d83d4152e4d13a15c1dec3fe34630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:00:54Z,use_quota=True,user_id='944336186b89405b88712ea1ee53743a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43191fb4-6ed5-4ce7-8f08-ec80dce30dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43191fb4-6ed5-4ce7-8f08-ec80dce30dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68bd29c-e42b-4f8c-b35e-e45d527f4868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68bd29c-e42b-4f8c-b35e-e45d527f4868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc', 'volume_name': 'volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a3cf20-c54b-4d21-ae9c-be735fe56698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a3cf20-c54b-4d21-ae9c-be735fe56698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b46249-3cfe-4eaf-89a0-392902ca6d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Volume 99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc', 'volume_size': 1} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1919003280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48d83d4152e4d13a15c1dec3fe34630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:00:54Z,use_quota=True,user_id='944336186b89405b88712ea1ee53743a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Creating volume 99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:00:54 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:00:54 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc 1073741824 Sep 28 19:00:54 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:55 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc 1073741824" returned: 0 in 0.837s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:00:55 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc Sep 28 19:00:55 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:00:56 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Sep 28 19:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc" returned: 0 in 0.562s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:00:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:00:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b46249-3cfe-4eaf-89a0-392902ca6d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965dcd56-253c-4b9f-9fe4-5d87dea725de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:00:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Volume volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc (99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc): created successfully Sep 28 19:00:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965dcd56-253c-4b9f-9fe4-5d87dea725de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:00:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Flow 'volume_create_manager' (d5395dc1-fc25-47ac-9f12-46dd455fec15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:00:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bae185a8-6062-4448-b393-5ad9a1cd489c tempest-ServersNegativeTestJSON-1521438976 None] Created volume successfully. Sep 28 19:01:00 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:01:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Flow 'volume_create_manager' (4a8aa38a-4736-4066-9ae1-949c384af7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:01:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bd7155-0b01-473d-9482-7ecd70074533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bd7155-0b01-473d-9482-7ecd70074533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1909905402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9c2429-9dee-4e07-a080-2e0cc87008b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48d83d4152e4d13a15c1dec3fe34630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:01:01Z,use_quota=True,user_id='944336186b89405b88712ea1ee53743a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a7617b-5805-43d5-97d1-9b38d1cd9c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a7617b-5805-43d5-97d1-9b38d1cd9c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f5c4aa-86e9-4176-9194-858dd75beb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f5c4aa-86e9-4176-9194-858dd75beb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe9c2429-9dee-4e07-a080-2e0cc87008b1', 'volume_name': 'volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d1ae7e-ceec-4605-a2e6-2d2d3bc4d4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d1ae7e-ceec-4605-a2e6-2d2d3bc4d4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7762ad93-61fe-41b7-b8cf-b00f9ae8cc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:01 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Volume fe9c2429-9dee-4e07-a080-2e0cc87008b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1', 'volume_size': 1} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1909905402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9c2429-9dee-4e07-a080-2e0cc87008b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48d83d4152e4d13a15c1dec3fe34630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:01:01Z,use_quota=True,user_id='944336186b89405b88712ea1ee53743a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Creating volume fe9c2429-9dee-4e07-a080-2e0cc87008b1 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:01:01 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:01 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1 1073741824 Sep 28 19:01:01 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:01 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1 1073741824" returned: 0 in 0.794s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:02 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1 Sep 28 19:01:02 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:02 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1" returned: 0 in 0.488s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:01:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7762ad93-61fe-41b7-b8cf-b00f9ae8cc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525b6ccc-1bf4-4f20-b76b-6e802281f0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Volume volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1 (fe9c2429-9dee-4e07-a080-2e0cc87008b1): created successfully Sep 28 19:01:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525b6ccc-1bf4-4f20-b76b-6e802281f0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Flow 'volume_create_manager' (4a8aa38a-4736-4066-9ae1-949c384af7b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:01:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d483402a-8cf3-47dc-b945-7bb2e005988d tempest-ServersNegativeTestJSON-1521438976 None] Created volume successfully. Sep 28 19:01:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Acquiring lock "cinder-fe9c2429-9dee-4e07-a080-2e0cc87008b1-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:01:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Lock "cinder-fe9c2429-9dee-4e07-a080-2e0cc87008b1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:01:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Acquiring lock "cinder-quobyte-fe9c2429-9dee-4e07-a080-2e0cc87008b1" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:01:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Lock "cinder-quobyte-fe9c2429-9dee-4e07-a080-2e0cc87008b1" acquired by "delete_volume" :: waited 0.042s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:01:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a44157-be6f-4070-b05c-12ffbe11b8e4]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:01:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:05 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1 Sep 28 19:01:05 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:05 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1" returned: 0 in 0.590s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:05 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1 Sep 28 19:01:05 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:05 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe9c2429-9dee-4e07-a080-2e0cc87008b1" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Lock "cinder-quobyte-fe9c2429-9dee-4e07-a080-2e0cc87008b1" released by "delete_volume" :: held 1.111s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Created reservations ['4471546a-89d7-4c37-a4db-c9a8afa85c4b', '62605197-a548-4abf-8f45-e1db41dd2e55', '07e018dd-a78c-4199-893b-95309157f7dc', '172f0ac9-9fc4-4974-966b-a14ee336421f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:06 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:01:06 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:06 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:01:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Deleted volume successfully. Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-948bbe5e-956e-451b-8bb1-d7c872d08f99 tempest-ServersNegativeTestJSON-1521438976 None] Lock "cinder-fe9c2429-9dee-4e07-a080-2e0cc87008b1-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Acquiring lock "cinder-03b32757-f306-4529-892f-7e4be1c4d2b7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Lock "cinder-03b32757-f306-4529-892f-7e4be1c4d2b7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Acquiring lock "cinder-quobyte-03b32757-f306-4529-892f-7e4be1c4d2b7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:01:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Lock "cinder-quobyte-03b32757-f306-4529-892f-7e4be1c4d2b7" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:01:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b6a64c-c752-46e3-8009-cc224c662dd0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:01:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:07 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7 Sep 28 19:01:07 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Acquiring lock "cinder-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:01:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Lock "cinder-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:01:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Acquiring lock "cinder-quobyte-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:01:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Lock "cinder-quobyte-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:01:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc856b9-d04e-4bbe-a510-d40d53fe0ac0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:01:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:07 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc Sep 28 19:01:07 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:07 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7" returned: 0 in 0.871s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:07 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7 Sep 28 19:01:07 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:08 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-03b32757-f306-4529-892f-7e4be1c4d2b7" returned: 0 in 0.438s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Lock "cinder-quobyte-03b32757-f306-4529-892f-7e4be1c4d2b7" released by "delete_volume" :: held 1.389s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:01:08 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc" returned: 0 in 0.916s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Created reservations ['58d279fa-c676-4fe8-a707-0b264938568b', 'bd6549b2-6cef-4825-abb8-4e4254845216', 'e0e9a259-f4a6-4165-b0bd-47c8861830fe', 'aabeb141-e940-42a8-8870-2bcef621b8e1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:01:08 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc Sep 28 19:01:08 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:08 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:01:08 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:09 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc" returned: 0 in 0.616s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:09 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.387s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Lock "cinder-quobyte-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc" released by "delete_volume" :: held 1.615s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:01:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Deleted volume successfully. Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9c3388aa-3e17-4950-8695-0471e49a022c tempest-ServerRescueNegativeTestJSON-1847309666 None] Lock "cinder-03b32757-f306-4529-892f-7e4be1c4d2b7-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Created reservations ['f2431b8a-c9d9-4e07-82f6-7d702a89fd98', 'f02d54ca-2030-4695-9ec5-ba3652bd4a5c', '60a6538b-e603-4c88-a77d-6afd7126de1d', 'b3e87b58-8fe2-4761-aeed-a65f39fbc345'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:09 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:01:09 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:09 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.514s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:09 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:01:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Deleted volume successfully. Sep 28 19:01:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59e46fa5-0a6e-4df8-a7a8-2bae7d8e4b55 tempest-ServersNegativeTestJSON-1521438976 None] Lock "cinder-99c5bb97-bca5-45ec-a4bd-d5132bcd9cbc-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:01:19 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=30,cinder:UPDATE=53,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:01:19 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=27,cinder:UPDATE=36,cinder:INSERT=11,cinder:DELETE=6 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:34 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:01:34 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:34 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.346s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 8 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:01:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Flow 'volume_create_manager' (518bd49e-5bef-402c-93b1-eaf5ec4398c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367b5583-3d31-45ae-aeec-302f6f63796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367b5583-3d31-45ae-aeec-302f6f63796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-217956997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d1cb0a-9c43-4086-bfb7-76c170db78a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96e669036e4e59a1ff4563c2d1c78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:01:40Z,use_quota=True,user_id='3d9ad68cf4484b2eb9091bdd44b34a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cd4413-650e-4556-bcaa-c6c71d3befc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cd4413-650e-4556-bcaa-c6c71d3befc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2442ab70-2ca1-49d6-aa82-40c27ecbe134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2442ab70-2ca1-49d6-aa82-40c27ecbe134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d1cb0a-9c43-4086-bfb7-76c170db78a3', 'volume_name': 'volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fa7460-10c2-44dc-a6cc-42daee62536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fa7460-10c2-44dc-a6cc-42daee62536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56620b57-95bc-47d8-9a59-5bd0a2ebf7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:39 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Volume 28d1cb0a-9c43-4086-bfb7-76c170db78a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3', 'volume_size': 1} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-217956997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d1cb0a-9c43-4086-bfb7-76c170db78a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96e669036e4e59a1ff4563c2d1c78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:01:40Z,use_quota=True,user_id='3d9ad68cf4484b2eb9091bdd44b34a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Creating volume 28d1cb0a-9c43-4086-bfb7-76c170db78a3 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:01:39 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:39 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3 1073741824 Sep 28 19:01:39 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:40 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3 1073741824" returned: 0 in 0.716s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:01:40 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3 Sep 28 19:01:40 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:01:40 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Sep 28 19:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3" returned: 0 in 0.430s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:01:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:01:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56620b57-95bc-47d8-9a59-5bd0a2ebf7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6459e7-c275-4298-bae2-8a32b170f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:01:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Volume volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3 (28d1cb0a-9c43-4086-bfb7-76c170db78a3): created successfully Sep 28 19:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6459e7-c275-4298-bae2-8a32b170f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Flow 'volume_create_manager' (518bd49e-5bef-402c-93b1-eaf5ec4398c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:01:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d65e2cfd-07d2-470d-8628-e7d4bd7c916f tempest-TaggedAttachmentsTest-1610450742 None] Created volume successfully. Sep 28 19:01:51 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:01:51 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:02:22 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Flow 'volume_create_manager' (7f1cdd05-0e12-42b7-a440-ad8fc82e0bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f6aeb4-8e5c-481f-8f8a-5946c66e3fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f6aeb4-8e5c-481f-8f8a-5946c66e3fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-710892913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afed0b46-ab65-4642-898c-65b0b2ae911a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381a4935680a4f61a9035d7232761e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:02:23Z,use_quota=True,user_id='a65595b7a0ae40cbaa5f34581ef395a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7bcb01-ea01-4781-bc19-530b77b0556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7bcb01-ea01-4781-bc19-530b77b0556e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14219142-7e13-4486-9bdc-4469cbb82e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14219142-7e13-4486-9bdc-4469cbb82e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afed0b46-ab65-4642-898c-65b0b2ae911a', 'volume_name': 'volume-afed0b46-ab65-4642-898c-65b0b2ae911a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3863c397-1036-497e-8c29-57dac4026178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3863c397-1036-497e-8c29-57dac4026178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42370a8f-39df-4267-a065-bfd57e752f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Volume afed0b46-ab65-4642-898c-65b0b2ae911a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afed0b46-ab65-4642-898c-65b0b2ae911a', 'volume_size': 1} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-710892913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afed0b46-ab65-4642-898c-65b0b2ae911a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381a4935680a4f61a9035d7232761e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:02:23Z,use_quota=True,user_id='a65595b7a0ae40cbaa5f34581ef395a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Creating volume afed0b46-ab65-4642-898c-65b0b2ae911a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:02:23 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:02:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:02:23 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a 1073741824 Sep 28 19:02:23 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:02:25 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Sep 28 19:02:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a 1073741824" returned: 0 in 1.751s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:02:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:02:25 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a Sep 28 19:02:25 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:02:25 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Sep 28 19:02:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a" returned: 0 in 0.622s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:02:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] <== create_volume: return (2541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:02:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.547s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:02:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42370a8f-39df-4267-a065-bfd57e752f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afed0b46-ab65-4642-898c-65b0b2ae911a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b516040-5abb-49fd-bb3b-890180a74ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Volume volume-afed0b46-ab65-4642-898c-65b0b2ae911a (afed0b46-ab65-4642-898c-65b0b2ae911a): created successfully Sep 28 19:02:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b516040-5abb-49fd-bb3b-890180a74ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Flow 'volume_create_manager' (7f1cdd05-0e12-42b7-a440-ad8fc82e0bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:02:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-46573556-37c1-45d5-bcf7-be42ec79cf21 tempest-DeleteServersTestJSON-805410119 None] Created volume successfully. Sep 28 19:02:33 devstack cinder-volume[86846]: WARNING py.warnings [req-9d122a10-0eff-49e2-9a5a-d57d60729ad4 req-b95cc9ca-9ef3-4c87-929a-ea726fb27a23 tempest-DeleteServersTestJSON-805410119 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 28 19:02:33 devstack cinder-volume[86846]: .first() Sep 28 19:02:33 devstack cinder-volume[86846]: Sep 28 19:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-9d122a10-0eff-49e2-9a5a-d57d60729ad4 req-b95cc9ca-9ef3-4c87-929a-ea726fb27a23 tempest-DeleteServersTestJSON-805410119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-9d122a10-0eff-49e2-9a5a-d57d60729ad4 req-b95cc9ca-9ef3-4c87-929a-ea726fb27a23 tempest-DeleteServersTestJSON-805410119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-9d122a10-0eff-49e2-9a5a-d57d60729ad4 req-b95cc9ca-9ef3-4c87-929a-ea726fb27a23 tempest-DeleteServersTestJSON-805410119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:02:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-9d122a10-0eff-49e2-9a5a-d57d60729ad4 req-b95cc9ca-9ef3-4c87-929a-ea726fb27a23 tempest-DeleteServersTestJSON-805410119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-afed0b46-ab65-4642-898c-65b0b2ae911a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'deded614-9180-4636-99eb-96ef83f4c8eb', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:02:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-9d122a10-0eff-49e2-9a5a-d57d60729ad4 req-b95cc9ca-9ef3-4c87-929a-ea726fb27a23 tempest-DeleteServersTestJSON-805410119 None] attachment_update completed successfully. Sep 28 19:02:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:02:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:02:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:02:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:02:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:02:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:02:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:02:34 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:02:34 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:02:35 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Sep 28 19:02:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.809s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:02:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:02:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 8 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:02:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-cb3e0891-6d19-44e7-8476-f825c7df16e3 req-77fffa93-ce06-4c5a-b2ae-ed6be141d5c1 tempest-DeleteServersTestJSON-805410119 None] Terminate volume connection completed successfully. Sep 28 19:02:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-cb3e0891-6d19-44e7-8476-f825c7df16e3 req-77fffa93-ce06-4c5a-b2ae-ed6be141d5c1 tempest-DeleteServersTestJSON-805410119 None] Deleting attachment deded614-9180-4636-99eb-96ef83f4c8eb. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:02:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Acquiring lock "cinder-afed0b46-ab65-4642-898c-65b0b2ae911a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:02:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Lock "cinder-afed0b46-ab65-4642-898c-65b0b2ae911a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:02:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Acquiring lock "cinder-quobyte-afed0b46-ab65-4642-898c-65b0b2ae911a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:02:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Lock "cinder-quobyte-afed0b46-ab65-4642-898c-65b0b2ae911a" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c842244-a2f1-4f62-9e6d-d5b5ddc00cdb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:02:41 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a Sep 28 19:02:41 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:02:41 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a" returned: 0 in 0.405s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:02:41 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a Sep 28 19:02:41 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:02:41 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-afed0b46-ab65-4642-898c-65b0b2ae911a" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Lock "cinder-quobyte-afed0b46-ab65-4642-898c-65b0b2ae911a" released by "delete_volume" :: held 0.749s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Created reservations ['fbfba701-a8f4-4e9e-af45-1c80043da1f5', 'e1766a1f-7373-4266-b410-575c579be699', 'f169f825-aced-4c48-967b-6ba783d97261', '6a08a23e-7841-45ec-ad37-26b88def626b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:02:41 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:02:41 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:02:42 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Sep 28 19:02:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.271s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:02:42 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:02:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Deleted volume successfully. Sep 28 19:02:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5456b340-f102-43ce-9890-f6f7c82bb52d tempest-DeleteServersTestJSON-805410119 None] Lock "cinder-afed0b46-ab65-4642-898c-65b0b2ae911a-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Flow 'volume_create_manager' (5687b5ea-b1be-48c9-94a9-299879c47335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37f12ba-557d-4718-af0f-d12f27a43431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37f12ba-557d-4718-af0f-d12f27a43431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-964787708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edcc128-2f84-45a8-adfb-356dba570102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e091d445614cd280f84462ed7a0bf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:02:49Z,use_quota=True,user_id='a8b1f8a7e5264289a869a7c7d42cf80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3b502a-dd01-4116-ba35-1b2ba93d3e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3b502a-dd01-4116-ba35-1b2ba93d3e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5f63ee-4791-43a6-a2a2-aadc951c4caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5f63ee-4791-43a6-a2a2-aadc951c4caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edcc128-2f84-45a8-adfb-356dba570102', 'volume_name': 'volume-9edcc128-2f84-45a8-adfb-356dba570102', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e803d2-5dfc-42a3-8170-98b172b56089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e803d2-5dfc-42a3-8170-98b172b56089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17d057f-3506-463a-9dfa-0c31112936a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Volume 9edcc128-2f84-45a8-adfb-356dba570102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edcc128-2f84-45a8-adfb-356dba570102', 'volume_size': 1} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-964787708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edcc128-2f84-45a8-adfb-356dba570102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e091d445614cd280f84462ed7a0bf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:02:49Z,use_quota=True,user_id='a8b1f8a7e5264289a869a7c7d42cf80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Creating volume 9edcc128-2f84-45a8-adfb-356dba570102 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:02:49 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:02:49 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102 1073741824 Sep 28 19:02:49 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:02:49 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Sep 28 19:02:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102 1073741824" returned: 0 in 0.680s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:02:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:02:50 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102 Sep 28 19:02:50 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:02:50 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Sep 28 19:02:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102" returned: 0 in 0.331s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:02:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17d057f-3506-463a-9dfa-0c31112936a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edcc128-2f84-45a8-adfb-356dba570102', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e85c05e-e49c-43fc-853f-2d247536b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Volume volume-9edcc128-2f84-45a8-adfb-356dba570102 (9edcc128-2f84-45a8-adfb-356dba570102): created successfully Sep 28 19:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e85c05e-e49c-43fc-853f-2d247536b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Flow 'volume_create_manager' (5687b5ea-b1be-48c9-94a9-299879c47335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:02:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-41dfaeb0-126d-45e7-b0a4-2afcc30870d2 tempest-AttachVolumeShelveTestJSON-1157738583 None] Created volume successfully. Sep 28 19:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-38a5e99c-5013-4e2a-839d-562ea3d22d61 req-645d7e1d-068f-4489-be71-1782c9a3aedc tempest-TaggedAttachmentsTest-1610450742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-38a5e99c-5013-4e2a-839d-562ea3d22d61 req-645d7e1d-068f-4489-be71-1782c9a3aedc tempest-TaggedAttachmentsTest-1610450742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-38a5e99c-5013-4e2a-839d-562ea3d22d61 req-645d7e1d-068f-4489-be71-1782c9a3aedc tempest-TaggedAttachmentsTest-1610450742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:02:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-38a5e99c-5013-4e2a-839d-562ea3d22d61 req-645d7e1d-068f-4489-be71-1782c9a3aedc tempest-TaggedAttachmentsTest-1610450742 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1b028ef-25e9-4e57-8094-73fd4a824ff3', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:02:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-38a5e99c-5013-4e2a-839d-562ea3d22d61 req-645d7e1d-068f-4489-be71-1782c9a3aedc tempest-TaggedAttachmentsTest-1610450742 None] attachment_update completed successfully. Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Flow 'volume_create_manager' (b8569c61-95aa-4491-bb80-c690d0fff315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b75903c-3516-4dcf-a655-1510e63860d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b75903c-3516-4dcf-a655-1510e63860d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-602107373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802a80e7-c571-4b41-af44-b16ea2f1c997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961e5debe00f482aba62a72e37a4d722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:02:57Z,use_quota=True,user_id='3da366075db246a595a0a088b764c66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee04a667-b21c-43d8-adc9-d7ee2a68d49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee04a667-b21c-43d8-adc9-d7ee2a68d49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5972c306-afda-4829-92a8-eccaaad45c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5972c306-afda-4829-92a8-eccaaad45c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802a80e7-c571-4b41-af44-b16ea2f1c997', 'volume_name': 'volume-802a80e7-c571-4b41-af44-b16ea2f1c997', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31ed2d3-4a3c-4d90-8afc-1b3399a66a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31ed2d3-4a3c-4d90-8afc-1b3399a66a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eceba49-a845-4306-a5f9-fc48afca5fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:57 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Volume 802a80e7-c571-4b41-af44-b16ea2f1c997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802a80e7-c571-4b41-af44-b16ea2f1c997', 'volume_size': 1} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-602107373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802a80e7-c571-4b41-af44-b16ea2f1c997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961e5debe00f482aba62a72e37a4d722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:02:57Z,use_quota=True,user_id='3da366075db246a595a0a088b764c66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Creating volume 802a80e7-c571-4b41-af44-b16ea2f1c997 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:02:57 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:02:57 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997 1073741824 Sep 28 19:02:57 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:02:58 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Sep 28 19:02:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997 1073741824" returned: 0 in 0.868s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:02:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:02:58 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997 Sep 28 19:02:58 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:02:58 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Sep 28 19:02:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997" returned: 0 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:02:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:02:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:02:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eceba49-a845-4306-a5f9-fc48afca5fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802a80e7-c571-4b41-af44-b16ea2f1c997', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfb9851-3ef9-41f4-87e5-6fe18c84f2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:02:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Volume volume-802a80e7-c571-4b41-af44-b16ea2f1c997 (802a80e7-c571-4b41-af44-b16ea2f1c997): created successfully Sep 28 19:02:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfb9851-3ef9-41f4-87e5-6fe18c84f2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:02:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Flow 'volume_create_manager' (b8569c61-95aa-4491-bb80-c690d0fff315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:02:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9b469d49-cc96-4d75-a846-bd56d3b9657d tempest-AttachVolumeTestJSON-496352046 None] Created volume successfully. Sep 28 19:03:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-07c15c89-0419-4c82-afe6-50c9ebef7be2 req-61fcc8ce-dad7-4562-9f6e-020c4a6edf04 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:03:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-07c15c89-0419-4c82-afe6-50c9ebef7be2 req-61fcc8ce-dad7-4562-9f6e-020c4a6edf04 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:03:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-07c15c89-0419-4c82-afe6-50c9ebef7be2 req-61fcc8ce-dad7-4562-9f6e-020c4a6edf04 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-07c15c89-0419-4c82-afe6-50c9ebef7be2 req-61fcc8ce-dad7-4562-9f6e-020c4a6edf04 tempest-AttachVolumeTestJSON-496352046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-802a80e7-c571-4b41-af44-b16ea2f1c997', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fcec715-9904-4b27-bb96-f40379b75cbf', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:03:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-07c15c89-0419-4c82-afe6-50c9ebef7be2 req-61fcc8ce-dad7-4562-9f6e-020c4a6edf04 tempest-AttachVolumeTestJSON-496352046 None] attachment_update completed successfully. Sep 28 19:03:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-0e38f1a1-e48d-490a-a5e1-a55dc1dba963 req-62edd3b8-674f-47de-9f6c-e91ca18278ec tempest-TaggedAttachmentsTest-1610450742 None] Terminate volume connection completed successfully. Sep 28 19:03:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-0e38f1a1-e48d-490a-a5e1-a55dc1dba963 req-62edd3b8-674f-47de-9f6c-e91ca18278ec tempest-TaggedAttachmentsTest-1610450742 None] Deleting attachment e1b028ef-25e9-4e57-8094-73fd4a824ff3. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:03:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-98efc07c-4826-4aa9-a677-2b7a70a13fc5 req-2d848e7b-7be5-4e5f-befd-4662fb042e2a tempest-AttachVolumeShelveTestJSON-1157738583 None] No connector for attachment c2f3bf70-ecf3-40bb-8fb1-8771730b382e; skipping storage backend terminate_connection call. {{(pid=86846) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 19:03:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-98efc07c-4826-4aa9-a677-2b7a70a13fc5 req-2d848e7b-7be5-4e5f-befd-4662fb042e2a tempest-AttachVolumeShelveTestJSON-1157738583 None] Deleting attachment c2f3bf70-ecf3-40bb-8fb1-8771730b382e. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:03:20 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=23,cinder:SELECT=33,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:03:20 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=35,cinder:UPDATE=21,cinder:INSERT=2,cinder:DELETE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:03:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Acquiring lock "cinder-28d1cb0a-9c43-4086-bfb7-76c170db78a3-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:03:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Lock "cinder-28d1cb0a-9c43-4086-bfb7-76c170db78a3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:03:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Acquiring lock "cinder-quobyte-28d1cb0a-9c43-4086-bfb7-76c170db78a3" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:03:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Lock "cinder-quobyte-28d1cb0a-9c43-4086-bfb7-76c170db78a3" acquired by "delete_volume" :: waited 0.062s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:03:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e91dfcc-2c1d-4781-929d-6d58e3f62f9a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:03:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:25 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3 Sep 28 19:03:25 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:26 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3" returned: 0 in 0.813s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:26 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3 Sep 28 19:03:26 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:26 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-28d1cb0a-9c43-4086-bfb7-76c170db78a3" returned: 0 in 0.523s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Lock "cinder-quobyte-28d1cb0a-9c43-4086-bfb7-76c170db78a3" released by "delete_volume" :: held 1.464s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:03:26 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Created reservations ['0ca16e42-4d50-4479-af05-400758c9e6a0', '00c9340c-9a7b-4a20-961b-9e234973e33c', '621ffb27-b723-4f93-ae58-b82a46f3c8cf', 'c551b8ae-fa69-429c-aa64-da269da1ba1a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:03:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:03:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:03:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:03:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:03:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:03:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:27 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:03:27 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:27 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.740s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:27 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:03:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Deleted volume successfully. Sep 28 19:03:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-900601fd-e687-4d74-8414-652669b5e7ed tempest-TaggedAttachmentsTest-1610450742 None] Lock "cinder-28d1cb0a-9c43-4086-bfb7-76c170db78a3-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:03:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:03:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:03:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:03:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:03:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:03:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:03:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:34 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:03:34 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:35 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.628s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:03:37 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3,cinder:INSERT=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:03:37 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:03:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-9c71719c-93a2-42d7-99c3-bb22f5a573f4 req-2750c45b-af74-409a-83d5-c5d29fa484a5 tempest-AttachVolumeTestJSON-496352046 None] Terminate volume connection completed successfully. Sep 28 19:03:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-9c71719c-93a2-42d7-99c3-bb22f5a573f4 req-2750c45b-af74-409a-83d5-c5d29fa484a5 tempest-AttachVolumeTestJSON-496352046 None] Deleting attachment 7fcec715-9904-4b27-bb96-f40379b75cbf. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Flow 'volume_create_manager' (a693b5fa-5744-4891-837b-e07670eb7940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b5233f-6714-47b3-909f-c39ded07de14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b5233f-6714-47b3-909f-c39ded07de14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1670662983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9452c86f-5b1c-455d-ac8c-b27e217dc5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412ebe88b1754cd08da44005695f45fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:03:49Z,use_quota=True,user_id='29d1a78608244b8580187a2a32af6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e850d2-4ae3-44e6-aa0c-c86bb4508b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e850d2-4ae3-44e6-aa0c-c86bb4508b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d6eff1-54f7-427c-80e7-7c20b1355c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d6eff1-54f7-427c-80e7-7c20b1355c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9452c86f-5b1c-455d-ac8c-b27e217dc5a9', 'volume_name': 'volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f48d3e1-aa20-4153-b3a9-1eaf1675422a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f48d3e1-aa20-4153-b3a9-1eaf1675422a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3c577c-3872-41d2-8ea8-dde55e6e57fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Volume 9452c86f-5b1c-455d-ac8c-b27e217dc5a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9', 'volume_size': 1} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1670662983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9452c86f-5b1c-455d-ac8c-b27e217dc5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412ebe88b1754cd08da44005695f45fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:03:49Z,use_quota=True,user_id='29d1a78608244b8580187a2a32af6882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Creating volume 9452c86f-5b1c-455d-ac8c-b27e217dc5a9 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:03:49 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:03:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:49 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 1073741824 Sep 28 19:03:49 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:50 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 1073741824" returned: 0 in 0.910s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:50 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 Sep 28 19:03:50 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:50 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" returned: 0 in 0.438s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:03:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:03:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3c577c-3872-41d2-8ea8-dde55e6e57fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57561188-7b69-42d0-95c2-d995a9cbbf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Volume volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 (9452c86f-5b1c-455d-ac8c-b27e217dc5a9): created successfully Sep 28 19:03:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57561188-7b69-42d0-95c2-d995a9cbbf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Flow 'volume_create_manager' (a693b5fa-5744-4891-837b-e07670eb7940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:03:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-065247b9-17d0-47f5-9788-cabe60872502 req-c63379fd-50bc-4db6-87f0-02a2b596ab09 tempest-VolumesSnapshotsTestJSON-1140156165 None] Created volume successfully. Sep 28 19:03:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:03:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:03:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Creating offline snapshot 471b5958-8e73-4240-b0b3-4007c9560eeb of volume 9452c86f-5b1c-455d-ac8c-b27e217dc5a9 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:03:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece6e48-287f-4b80-9419-3f7eb20eb9df]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:03:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:52 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 Sep 28 19:03:52 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:52 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:03:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Flow 'volume_create_manager' (3094b369-e0bc-4779-85f2-37f659d0109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:03:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b01386-7ff5-4d8c-89d6-8a4524e34a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b01386-7ff5-4d8c-89d6-8a4524e34a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1180484558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1686e9a-8ae4-47bf-86a7-fc5af15fbf03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a0b452bb1e41659d5e4c24ba8b602b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:03:53Z,use_quota=True,user_id='ddbd3c35efed478f8d5dae97ce3f7c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952e75fd-2e4a-45a1-93f9-b4044e111fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952e75fd-2e4a-45a1-93f9-b4044e111fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2aa9a08-f455-490d-ae53-6f3e94c7d036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2aa9a08-f455-490d-ae53-6f3e94c7d036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1686e9a-8ae4-47bf-86a7-fc5af15fbf03', 'volume_name': 'volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3d8498-632e-46fc-931b-8a4c6f18e5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3d8498-632e-46fc-931b-8a4c6f18e5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681e8f5c-34cf-48ae-8afb-be38eea26fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:53 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Volume d1686e9a-8ae4-47bf-86a7-fc5af15fbf03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03', 'volume_size': 1} Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:03:53 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" returned: 0 in 0.792s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:53 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb 1G Sep 28 19:03:53 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:54 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb 1G" returned: 0 in 0.779s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:54 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb Sep 28 19:03:54 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:54 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb" returned: 0 in 0.444s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:54 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb is being set with open permissions: ugo+rw Sep 28 19:03:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:54 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb Sep 28 19:03:54 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:54 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:55 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.info Sep 28 19:03:55 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:55 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.info" returned: 0 in 0.316s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:55 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.info is being set with open permissions: ugo+rw Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:55 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.info Sep 28 19:03:55 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:55 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.info" returned: 0 in 0.303s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.155s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.610s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1180484558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1686e9a-8ae4-47bf-86a7-fc5af15fbf03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a0b452bb1e41659d5e4c24ba8b602b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:03:53Z,use_quota=True,user_id='ddbd3c35efed478f8d5dae97ce3f7c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Creating volume d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:03:55 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:03:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:55 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 1073741824 Sep 28 19:03:55 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-f71c196f-5981-4dac-bf53-b7a8cf14fefe req-a64bb4f0-76c8-4a10-81d6-9e74248261bf tempest-VolumesSnapshotsTestJSON-1140156165 None] Create snapshot completed successfully Sep 28 19:03:56 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 1073741824" returned: 0 in 0.555s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Acquiring lock "cinder-471b5958-8e73-4240-b0b3-4007c9560eeb-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:03:56 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 Sep 28 19:03:56 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "cinder-471b5958-8e73-4240-b0b3-4007c9560eeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Acquiring lock "cinder-quobyte-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "cinder-quobyte-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Acquiring lock "cinder-quobyte-471b5958-8e73-4240-b0b3-4007c9560eeb" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "cinder-quobyte-471b5958-8e73-4240-b0b3-4007c9560eeb" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Deleting offline snapshot 471b5958-8e73-4240-b0b3-4007c9560eeb of volume 9452c86f-5b1c-455d-ac8c-b27e217dc5a9 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] snapshot_file for this snap is: volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e25a593-6cd3-41f4-bc3e-0f41f528033d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:56 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb Sep 28 19:03:56 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:56 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03" returned: 0 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681e8f5c-34cf-48ae-8afb-be38eea26fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96194157-2cc7-4432-8259-6b4da685e525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:03:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Volume volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 (d1686e9a-8ae4-47bf-86a7-fc5af15fbf03): created successfully Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96194157-2cc7-4432-8259-6b4da685e525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:03:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Flow 'volume_create_manager' (3094b369-e0bc-4779-85f2-37f659d0109d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:03:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0c6fd99b-f6bc-4511-9e9f-b263c3ee1092 tempest-ServerActionsTestOtherA-1124315465 None] Created volume successfully. Sep 28 19:03:56 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb" returned: 0 in 0.515s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:03:57 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c5cd4-f9a2-4471-b6fa-efba7deab9df]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:03:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:57 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 Sep 28 19:03:57 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:57 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" returned: 0 in 0.487s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:57 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb Sep 28 19:03:57 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:57 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb" returned: 0 in 0.460s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:03:58 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb Sep 28 19:03:58 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:03:58 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Sep 28 19:03:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9.471b5958-8e73-4240-b0b3-4007c9560eeb" returned: 0 in 0.379s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:03:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "cinder-quobyte-471b5958-8e73-4240-b0b3-4007c9560eeb" released by "_delete_snapshot" :: held 2.056s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:03:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "cinder-quobyte-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" released by "delete_snapshot" :: held 2.124s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:03:58 devstack cinder-volume[86846]: WARNING cinder.quota [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:03:58 devstack cinder-volume[86846]: DEBUG cinder.quota [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Created reservations ['bb565bbd-61a1-4ebd-9d2e-1b38fdfe649e', '278ae16a-edc9-400a-8ddc-f2328b9941a2', '4a631a89-ea0d-4843-9e6a-1203ddc276b4', '37cc5ed2-86a9-4c6c-90c6-fa8b3ce23742'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:03:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Delete snapshot completed successfully. Sep 28 19:03:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-a47a607a-5b4e-460e-ab95-a2a91d3425fc req-d09b5c13-73f1-45f2-ba28-ff90ba585111 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "cinder-471b5958-8e73-4240-b0b3-4007c9560eeb-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Acquiring lock "cinder-9452c86f-5b1c-455d-ac8c-b27e217dc5a9-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "cinder-9452c86f-5b1c-455d-ac8c-b27e217dc5a9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Acquiring lock "cinder-quobyte-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "cinder-quobyte-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" acquired by "delete_volume" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[648f1b6d-716f-4e9a-9b98-9f042a25744f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:00 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 Sep 28 19:04:00 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:00 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" returned: 0 in 0.492s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:00 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9 Sep 28 19:04:00 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:01 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" returned: 0 in 0.333s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "cinder-quobyte-9452c86f-5b1c-455d-ac8c-b27e217dc5a9" released by "delete_volume" :: held 0.933s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG cinder.quota [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Created reservations ['fd57c618-df9a-4c12-8791-bae62e76534c', '0a6809f5-bae8-4a4f-b18d-09805f1bd067', '23e2f015-9a7b-4d8b-8b77-3a88dfa3502e', '89611f7d-4762-447b-84c0-4a2ecebe1437'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:01 devstack sudo[91753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:04:01 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:01 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG cinder.manager [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:04:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Deleted volume successfully. Sep 28 19:04:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-4fbe4bdf-83ef-4128-ab14-c4f9928c70e9 req-2b9d1b70-64f6-49a9-995c-788d5edc36d9 tempest-VolumesSnapshotsTestJSON-1140156165 None] Lock "cinder-9452c86f-5b1c-455d-ac8c-b27e217dc5a9-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:11 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=15,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:04:11 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:04:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-42a789e2-150e-4467-bf78-7f763110c116 tempest-GroupsV320Test-575511352 None] Group tempest-GroupsV320Test-Group-604003830: creating Sep 28 19:04:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-42a789e2-150e-4467-bf78-7f763110c116 tempest-GroupsV320Test-575511352 None] Group tempest-GroupsV320Test-Group-604003830: created successfully Sep 28 19:04:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-42a789e2-150e-4467-bf78-7f763110c116 tempest-GroupsV320Test-575511352 None] Create group completed successfully. Sep 28 19:04:18 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-64158657-ea60-46ba-ac0f-8675a326ad08 tempest-GroupsV320Test-575511352 None] Created reservations ['c66bb053-e1a8-4ce7-9e35-0e0948c742df'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:04:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-64158657-ea60-46ba-ac0f-8675a326ad08 tempest-GroupsV320Test-575511352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-64158657-ea60-46ba-ac0f-8675a326ad08 tempest-GroupsV320Test-575511352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-64158657-ea60-46ba-ac0f-8675a326ad08 tempest-GroupsV320Test-575511352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:04:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-64158657-ea60-46ba-ac0f-8675a326ad08 tempest-GroupsV320Test-575511352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:04:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-64158657-ea60-46ba-ac0f-8675a326ad08 tempest-GroupsV320Test-575511352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64158657-ea60-46ba-ac0f-8675a326ad08 tempest-GroupsV320Test-575511352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:19 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:04:19 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:19 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64158657-ea60-46ba-ac0f-8675a326ad08 tempest-GroupsV320Test-575511352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-64158657-ea60-46ba-ac0f-8675a326ad08 tempest-GroupsV320Test-575511352 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:04:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-64158657-ea60-46ba-ac0f-8675a326ad08 tempest-GroupsV320Test-575511352 None] Delete group completed successfully. Sep 28 19:04:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Acquiring lock "cinder-9edcc128-2f84-45a8-adfb-356dba570102-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Lock "cinder-9edcc128-2f84-45a8-adfb-356dba570102-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Acquiring lock "cinder-quobyte-9edcc128-2f84-45a8-adfb-356dba570102" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Lock "cinder-quobyte-9edcc128-2f84-45a8-adfb-356dba570102" acquired by "delete_volume" :: waited 0.053s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:19 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd917d77-3777-417b-8a79-45ca544607a7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:20 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102 Sep 28 19:04:20 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:20 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102" returned: 0 in 0.526s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:20 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102 Sep 28 19:04:20 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:20 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9edcc128-2f84-45a8-adfb-356dba570102" returned: 0 in 0.460s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Lock "cinder-quobyte-9edcc128-2f84-45a8-adfb-356dba570102" released by "delete_volume" :: held 1.080s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:21 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Created reservations ['477deb4a-49ad-4ffb-918c-e22e4348ef5a', '5a00403d-2dad-400f-85ec-692178a15331', 'dd79d9c9-f35f-4f9f-ac67-79c799ee8d6a', '5d9c091e-1772-4d9d-b043-bf295b541e7f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:04:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:04:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:04:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:21 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:04:21 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:21 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.465s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:21 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:04:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Deleted volume successfully. Sep 28 19:04:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb2e48ec-8909-4edf-8aa9-93fb19bef489 tempest-AttachVolumeShelveTestJSON-1157738583 None] Lock "cinder-9edcc128-2f84-45a8-adfb-356dba570102-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=13,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=10,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Flow 'volume_create_manager' (c0271abd-cd03-4c3e-955d-5858a91fed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cc3b59-cd41-4a18-85c7-e854389675bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cc3b59-cd41-4a18-85c7-e854389675bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-615372827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fefcd6-a230-41f4-bdf8-a077c62e42c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d98a83f65c44e5944e206e8382fc68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:04:32Z,use_quota=True,user_id='165f532d051e47b485627ab0edfb176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae277951-e7fa-49ad-8347-e2f0ddf5749f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae277951-e7fa-49ad-8347-e2f0ddf5749f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d0107b-8536-4ca4-ac72-eed15961e66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d0107b-8536-4ca4-ac72-eed15961e66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64fefcd6-a230-41f4-bdf8-a077c62e42c5', 'volume_name': 'volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8229cac8-5c46-4eaa-85ad-bc73d1da9d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8229cac8-5c46-4eaa-85ad-bc73d1da9d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd0bad4-24fa-4a6a-b2be-30473d6793e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5', 'volume_size': 1} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-615372827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fefcd6-a230-41f4-bdf8-a077c62e42c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d98a83f65c44e5944e206e8382fc68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:04:32Z,use_quota=True,user_id='165f532d051e47b485627ab0edfb176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Creating volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:04:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:04:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:31 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 1073741824 Sep 28 19:04:31 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-732ff63b-6afe-4956-b807-762dc4250e16 req-2aaed363-b512-4ef8-b19e-f730db5021c7 tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:32 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 1073741824" returned: 0 in 0.746s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:32 devstack sudo[92023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 Sep 28 19:04:32 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:33 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5" returned: 0 in 0.411s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:04:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-732ff63b-6afe-4956-b807-762dc4250e16 req-2aaed363-b512-4ef8-b19e-f730db5021c7 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.663s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd0bad4-24fa-4a6a-b2be-30473d6793e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0806d185-a2f9-42e4-8db1-2e356bfd79a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-732ff63b-6afe-4956-b807-762dc4250e16 req-2aaed363-b512-4ef8-b19e-f730db5021c7 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.124s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:33 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Volume volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 (64fefcd6-a230-41f4-bdf8-a077c62e42c5): created successfully Sep 28 19:04:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0806d185-a2f9-42e4-8db1-2e356bfd79a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Flow 'volume_create_manager' (c0271abd-cd03-4c3e-955d-5858a91fed91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:04:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-372c9f04-875e-4949-b17a-233e40b76e55 tempest-SnapshotsActionsTest-353721352 None] Created volume successfully. Sep 28 19:04:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-732ff63b-6afe-4956-b807-762dc4250e16 req-2aaed363-b512-4ef8-b19e-f730db5021c7 tempest-ServerActionsTestOtherA-1124315465 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29e0109f-68dc-493e-b419-ba0c5f33f800', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:04:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-732ff63b-6afe-4956-b807-762dc4250e16 req-2aaed363-b512-4ef8-b19e-f730db5021c7 tempest-ServerActionsTestOtherA-1124315465 None] attachment_update completed successfully. Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Creating offline snapshot 026315c7-4797-48ca-828b-e6e5d8227193 of volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a60b92-1910-4237-800b-a954e0186a04]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:04:34 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 Sep 28 19:04:34 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:34 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:04:34 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:35 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5" returned: 0 in 0.741s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:35 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.575s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:04:35 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 1G Sep 28 19:04:35 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 8 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Flow 'volume_create_manager' (fb0096fa-1929-4e14-a33b-34a0929c43c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5073cbc9-2118-4393-a569-4241bee7b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5073cbc9-2118-4393-a569-4241bee7b977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1604914668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af98684-e20d-48b2-9f07-30c49cc46d2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b18a62f0cd347d7a05e54509fdaafb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:04:35Z,use_quota=True,user_id='0767868812c846bfb57bfb5fd0ca831c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10943bf6-e121-4a32-bdaf-9eadb1d8bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10943bf6-e121-4a32-bdaf-9eadb1d8bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b72e4b3-b4d0-45f4-b650-000dbee7c3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b72e4b3-b4d0-45f4-b650-000dbee7c3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af98684-e20d-48b2-9f07-30c49cc46d2a', 'volume_name': 'volume-8af98684-e20d-48b2-9f07-30c49cc46d2a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614a1b9e-c3ee-44a4-a2ad-9272e36ba82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614a1b9e-c3ee-44a4-a2ad-9272e36ba82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21d3094-e90c-4e83-a797-13344c158515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Volume 8af98684-e20d-48b2-9f07-30c49cc46d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af98684-e20d-48b2-9f07-30c49cc46d2a', 'volume_size': 1} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:35 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 1G" returned: 0 in 0.686s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:35 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:04:35 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:36 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.385s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:36 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 is being set with open permissions: ugo+rw Sep 28 19:04:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:36 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:04:36 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:36 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:36 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.info Sep 28 19:04:36 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:37 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.info" returned: 0 in 0.446s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:37 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.info is being set with open permissions: ugo+rw Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:37 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.info Sep 28 19:04:37 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:37 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.info" returned: 0 in 0.312s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.066s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.984s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1604914668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af98684-e20d-48b2-9f07-30c49cc46d2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b18a62f0cd347d7a05e54509fdaafb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:04:35Z,use_quota=True,user_id='0767868812c846bfb57bfb5fd0ca831c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Creating volume 8af98684-e20d-48b2-9f07-30c49cc46d2a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:04:37 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:04:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:37 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a 1073741824 Sep 28 19:04:37 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-912b7c3f-a597-49bf-b199-5b05e78bac66 tempest-SnapshotsActionsTest-353721352 None] Create snapshot completed successfully Sep 28 19:04:38 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a 1073741824" returned: 0 in 0.782s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:38 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a Sep 28 19:04:38 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:38 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a" returned: 0 in 0.559s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:04:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21d3094-e90c-4e83-a797-13344c158515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af98684-e20d-48b2-9f07-30c49cc46d2a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f075d973-f2c3-44b3-9082-56b625c47686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:04:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Volume volume-8af98684-e20d-48b2-9f07-30c49cc46d2a (8af98684-e20d-48b2-9f07-30c49cc46d2a): created successfully Sep 28 19:04:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f075d973-f2c3-44b3-9082-56b625c47686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:04:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Flow 'volume_create_manager' (fb0096fa-1929-4e14-a33b-34a0929c43c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:04:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-02342a40-b2dd-42e9-a1e6-408e3c46bb8f req-eb2dcff8-ac51-489f-92d7-d42916adfa23 tempest-VolumesGetTestJSON-768398989 None] Created volume successfully. Sep 28 19:04:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] Creating offline snapshot d167da86-4b11-43cd-87d0-e98271b9fb73 of volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:04:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee527b-35b8-470a-9311-e4355be3627a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-224cbbf2-a797-4ce9-915b-b50e83e56e58 req-b9e7c78c-3757-4d89-8a56-d35be7da2463 tempest-ServerActionsTestOtherA-1124315465 None] Terminate volume connection completed successfully. Sep 28 19:04:40 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:04:40 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-224cbbf2-a797-4ce9-915b-b50e83e56e58 req-b9e7c78c-3757-4d89-8a56-d35be7da2463 tempest-ServerActionsTestOtherA-1124315465 None] Deleting attachment 29e0109f-68dc-493e-b419-ba0c5f33f800. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:04:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Acquiring lock "cinder-8af98684-e20d-48b2-9f07-30c49cc46d2a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Lock "cinder-8af98684-e20d-48b2-9f07-30c49cc46d2a-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Acquiring lock "cinder-quobyte-8af98684-e20d-48b2-9f07-30c49cc46d2a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Lock "cinder-quobyte-8af98684-e20d-48b2-9f07-30c49cc46d2a" acquired by "delete_volume" :: waited 0.052s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:41 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08a9aef-c382-41a4-aeb0-10be39dbc962]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:41 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 1.037s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:04:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:41 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 1G Sep 28 19:04:41 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:41 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a Sep 28 19:04:41 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:42 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a" returned: 0 in 1.113s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:42 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a Sep 28 19:04:42 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:42 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 1G" returned: 0 in 0.967s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-224cbbf2-a797-4ce9-915b-b50e83e56e58 req-7a3fe939-7c2d-49d1-8e2c-51fda8a958a8 tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:42 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 Sep 28 19:04:42 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:42 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8af98684-e20d-48b2-9f07-30c49cc46d2a" returned: 0 in 0.573s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Lock "cinder-quobyte-8af98684-e20d-48b2-9f07-30c49cc46d2a" released by "delete_volume" :: held 1.816s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:42 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73" returned: 0 in 0.546s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:42 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 is being set with open permissions: ugo+rw Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:42 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 Sep 28 19:04:42 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG cinder.quota [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Created reservations ['6c2c1d25-23dc-410c-91b0-e4436bcb38b1', '7d51406f-056a-441c-bbe3-39ac2a088e39', '63b92183-9d07-41d5-a856-76ebdd2146a3', '9c42faf7-8ab7-48c8-9e21-402876adce36'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:42 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:04:43 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:43 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.057s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-224cbbf2-a797-4ce9-915b-b50e83e56e58 req-7a3fe939-7c2d-49d1-8e2c-51fda8a958a8 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.891s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-224cbbf2-a797-4ce9-915b-b50e83e56e58 req-7a3fe939-7c2d-49d1-8e2c-51fda8a958a8 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ed137097-7163-4b9c-a91a-b218054fbc02 tempest-SnapshotsActionsTest-353721352 None] Create snapshot completed successfully Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-224cbbf2-a797-4ce9-915b-b50e83e56e58 req-7a3fe939-7c2d-49d1-8e2c-51fda8a958a8 tempest-ServerActionsTestOtherA-1124315465 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38771c26-d96d-4a4d-818b-23d77e7ce7b6', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:04:43 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.manager [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:04:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Deleted volume successfully. Sep 28 19:04:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-224cbbf2-a797-4ce9-915b-b50e83e56e58 req-7a3fe939-7c2d-49d1-8e2c-51fda8a958a8 tempest-ServerActionsTestOtherA-1124315465 None] attachment_update completed successfully. Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-aeb9ad4f-2a6d-4470-9f50-e71aac9894ae req-044d7841-1ed5-4082-bb5f-0366d3d7f81b tempest-VolumesGetTestJSON-768398989 None] Lock "cinder-8af98684-e20d-48b2-9f07-30c49cc46d2a-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-d167da86-4b11-43cd-87d0-e98271b9fb73-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-d167da86-4b11-43cd-87d0-e98271b9fb73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-quobyte-d167da86-4b11-43cd-87d0-e98271b9fb73" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-d167da86-4b11-43cd-87d0-e98271b9fb73" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Deleting offline snapshot d167da86-4b11-43cd-87d0-e98271b9fb73 of volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] snapshot_file for this snap is: volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a253b825-8e76-4df5-a2cc-143ab85aeb45]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:44 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 Sep 28 19:04:44 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:44 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73" returned: 0 in 0.603s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:04:44 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d51fd68-8b69-4a0d-a621-870e0c9559c6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:44 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:04:44 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:45 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.481s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:04:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:45 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 Sep 28 19:04:45 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:45 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73" returned: 0 in 0.838s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:45 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73 Sep 28 19:04:45 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:46 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.d167da86-4b11-43cd-87d0-e98271b9fb73" returned: 0 in 0.636s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-d167da86-4b11-43cd-87d0-e98271b9fb73" released by "_delete_snapshot" :: held 2.792s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" released by "delete_snapshot" :: held 2.845s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:46 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Created reservations ['affcdb97-bad1-440f-be85-98e40773dd42', '8380b34c-3aff-487a-a84a-e672c831e65d', '604efa17-abbb-4628-a07e-be78be928a6d', 'cab557f2-10f3-4fe1-ae88-a9cc2a28bdb2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:04:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Delete snapshot completed successfully. Sep 28 19:04:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d88a13c-d8c7-4a70-ba25-452c63dfb23e tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-d167da86-4b11-43cd-87d0-e98271b9fb73-delete_snapshot" released by "delete_snapshot" :: held 3.256s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] Creating offline snapshot af63b830-c673-45ad-884c-25994c5edc17 of volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:04:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c026886-745c-41fd-965a-48432499f8a6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:47 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:04:47 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:48 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.487s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:04:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:48 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 1G Sep 28 19:04:48 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:49 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 1G" returned: 0 in 0.925s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:49 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 Sep 28 19:04:49 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:49 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17" returned: 0 in 0.627s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:49 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 is being set with open permissions: ugo+rw Sep 28 19:04:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:49 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 Sep 28 19:04:49 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:50 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17" returned: 0 in 0.331s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c5a31195-a109-4f6f-b359-901ba90988b6 tempest-SnapshotsActionsTest-353721352 None] Create snapshot completed successfully Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-af63b830-c673-45ad-884c-25994c5edc17-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-af63b830-c673-45ad-884c-25994c5edc17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-quobyte-af63b830-c673-45ad-884c-25994c5edc17" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-af63b830-c673-45ad-884c-25994c5edc17" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Deleting offline snapshot af63b830-c673-45ad-884c-25994c5edc17 of volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] snapshot_file for this snap is: volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea839f2-d579-47bc-81e0-05e8c6ca38ca]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:51 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 Sep 28 19:04:51 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:51 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17" returned: 0 in 0.456s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-26e9e742-3eb9-48cb-8b25-c564d1f5f1b8 tempest-BackendsCapabilitiesAdminTestsJSON-2009888073 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0996932983398, 'free_capacity_gb': 1775.0996932983398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86846) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502c365-19e1-4ff2-959a-e01dc434228d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a7ebbdc-595c-4292-a67c-b03728f56d84 tempest-BackendsCapabilitiesAdminTestsJSON-2009888073 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0996932983398, 'free_capacity_gb': 1775.0996932983398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86846) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 19:04:51 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:04:51 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:52 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.490s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:04:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:52 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 Sep 28 19:04:52 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:52 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17" returned: 0 in 0.500s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:52 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17 Sep 28 19:04:52 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:53 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.af63b830-c673-45ad-884c-25994c5edc17" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-af63b830-c673-45ad-884c-25994c5edc17" released by "_delete_snapshot" :: held 1.912s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" released by "delete_snapshot" :: held 1.958s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:53 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Created reservations ['406fe1ad-0748-4e79-b339-31c840e58d95', '2d11fb02-69b9-49d1-9b03-87174194a349', 'ba11fc72-7601-411f-b886-5e4bec017fac', '2a6b4f14-fa2a-460d-b196-e0d2cf313de6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:04:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Delete snapshot completed successfully. Sep 28 19:04:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-696d4af4-8a06-4ffa-b6d6-76d6ad112fed tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-af63b830-c673-45ad-884c-25994c5edc17-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] Creating offline snapshot 1359a480-1f08-44ce-9cba-cd68b2378c2a of volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:04:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdff070-65ab-4899-8357-53826f75004b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:53 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:04:54 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:54 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.474s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:04:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:54 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a 1G Sep 28 19:04:54 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:54 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a 1G" returned: 0 in 0.647s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:55 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a Sep 28 19:04:55 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:55 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a" returned: 0 in 0.396s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:55 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a is being set with open permissions: ugo+rw Sep 28 19:04:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:55 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a Sep 28 19:04:55 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:55 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:04:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d5eda826-d11b-42b8-96d9-4eef518e7585 tempest-SnapshotsActionsTest-353721352 None] Create snapshot completed successfully Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-1359a480-1f08-44ce-9cba-cd68b2378c2a-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-1359a480-1f08-44ce-9cba-cd68b2378c2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-quobyte-1359a480-1f08-44ce-9cba-cd68b2378c2a" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-1359a480-1f08-44ce-9cba-cd68b2378c2a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Deleting offline snapshot 1359a480-1f08-44ce-9cba-cd68b2378c2a of volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] snapshot_file for this snap is: volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbc5382-3e69-4722-8a23-e31d67eb0eab]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:56 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a Sep 28 19:04:56 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:56 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a" returned: 0 in 0.438s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d96e6e6-9d35-4aff-b195-a8624bcdb7dc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:56 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:04:56 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:57 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.530s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:04:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:57 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a Sep 28 19:04:57 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:57 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a" returned: 0 in 0.583s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:04:57 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a Sep 28 19:04:57 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:04:58 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Sep 28 19:04:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.1359a480-1f08-44ce-9cba-cd68b2378c2a" returned: 0 in 0.331s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:04:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-1359a480-1f08-44ce-9cba-cd68b2378c2a" released by "_delete_snapshot" :: held 2.018s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" released by "delete_snapshot" :: held 2.049s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:58 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Created reservations ['d47c8a30-a990-401d-b2fc-101b0786f910', '6c9e4d14-d20f-4c17-b6ce-568dbd5b3704', '836cfc7c-72d1-4b15-9575-aea0ad04c132', 'b8168ef6-7b78-4616-adff-4630b05e42c6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:04:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Delete snapshot completed successfully. Sep 28 19:04:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6843cdb6-3c12-4272-a3b7-42cdc73ef082 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-1359a480-1f08-44ce-9cba-cd68b2378c2a-delete_snapshot" released by "delete_snapshot" :: held 2.339s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:04:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:04:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:04:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] Creating offline snapshot 99ec4235-c4d4-4080-8ef9-d6b531976c5f of volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:04:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d433a70-44d7-4f6f-b50d-f561a79d3e4c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:04:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:00 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:05:00 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:00 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.614s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:05:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:00 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f 1G Sep 28 19:05:00 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Flow 'volume_create_manager' (be577bc1-f5ee-4b5a-8e10-3a7ee31183ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab071953-7b21-4a08-ad8d-cab0401571e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab071953-7b21-4a08-ad8d-cab0401571e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-552967620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf18f4fd-367b-41f5-a7ad-1d590a5b064c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961e5debe00f482aba62a72e37a4d722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:01Z,use_quota=True,user_id='3da366075db246a595a0a088b764c66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063e78e6-4ddc-4c82-9f14-939b521e67e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063e78e6-4ddc-4c82-9f14-939b521e67e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12cd9aa6-5126-4c6d-82f2-316dd578fd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12cd9aa6-5126-4c6d-82f2-316dd578fd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf18f4fd-367b-41f5-a7ad-1d590a5b064c', 'volume_name': 'volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4e12f6-be4e-4db6-b3cd-288b017c27e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4e12f6-be4e-4db6-b3cd-288b017c27e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60347bae-221b-479c-a280-de3390f95987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:01 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Volume cf18f4fd-367b-41f5-a7ad-1d590a5b064c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c', 'volume_size': 1} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:01 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f 1G" returned: 0 in 0.777s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:01 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f Sep 28 19:05:01 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:01 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:01 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f is being set with open permissions: ugo+rw Sep 28 19:05:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:01 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f Sep 28 19:05:01 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:02 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-552967620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf18f4fd-367b-41f5-a7ad-1d590a5b064c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961e5debe00f482aba62a72e37a4d722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:01Z,use_quota=True,user_id='3da366075db246a595a0a088b764c66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Creating volume cf18f4fd-367b-41f5-a7ad-1d590a5b064c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:05:02 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:02 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c 1073741824 Sep 28 19:05:02 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a450a1b4-584f-47fa-82bf-1539c8ee12ee tempest-SnapshotsActionsTest-353721352 None] Create snapshot completed successfully Sep 28 19:05:02 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c 1073741824" returned: 0 in 0.592s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:02 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c Sep 28 19:05:02 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:03 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c" returned: 0 in 0.361s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60347bae-221b-479c-a280-de3390f95987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc9daf8-3c0e-4d5e-9ea8-9cc84bfeb0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:03 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Volume volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c (cf18f4fd-367b-41f5-a7ad-1d590a5b064c): created successfully Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc9daf8-3c0e-4d5e-9ea8-9cc84bfeb0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Flow 'volume_create_manager' (be577bc1-f5ee-4b5a-8e10-3a7ee31183ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-40f5401f-052e-44b7-8386-65e4c1dd7be3 tempest-AttachVolumeTestJSON-496352046 None] Created volume successfully. Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-99ec4235-c4d4-4080-8ef9-d6b531976c5f-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-99ec4235-c4d4-4080-8ef9-d6b531976c5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Acquiring lock "cinder-quobyte-99ec4235-c4d4-4080-8ef9-d6b531976c5f" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-99ec4235-c4d4-4080-8ef9-d6b531976c5f" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Deleting offline snapshot 99ec4235-c4d4-4080-8ef9-d6b531976c5f of volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] snapshot_file for this snap is: volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[057fd4e1-0b12-4ac8-9075-882cff1ddf7c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:03 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f Sep 28 19:05:03 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:04 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f" returned: 0 in 0.569s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:05:04 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0e4919-b06d-4c60-a166-b1bdca2552cc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:04 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:05:04 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:04 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.588s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:05:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:04 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f Sep 28 19:05:04 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:05 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f" returned: 0 in 0.639s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:05 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f Sep 28 19:05:05 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-d1e600cd-2603-4742-bcaf-5b932f8e7652 req-0a3b0cbf-61ad-4cdc-831d-3f06677523e0 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-d1e600cd-2603-4742-bcaf-5b932f8e7652 req-0a3b0cbf-61ad-4cdc-831d-3f06677523e0 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-d1e600cd-2603-4742-bcaf-5b932f8e7652 req-0a3b0cbf-61ad-4cdc-831d-3f06677523e0 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-d1e600cd-2603-4742-bcaf-5b932f8e7652 req-0a3b0cbf-61ad-4cdc-831d-3f06677523e0 tempest-AttachVolumeTestJSON-496352046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6c43226-b96f-4d41-8f91-2868b5df82cd', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:05:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-d1e600cd-2603-4742-bcaf-5b932f8e7652 req-0a3b0cbf-61ad-4cdc-831d-3f06677523e0 tempest-AttachVolumeTestJSON-496352046 None] attachment_update completed successfully. Sep 28 19:05:05 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.99ec4235-c4d4-4080-8ef9-d6b531976c5f" returned: 0 in 0.391s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-99ec4235-c4d4-4080-8ef9-d6b531976c5f" released by "_delete_snapshot" :: held 2.425s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" released by "delete_snapshot" :: held 2.482s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:06 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Created reservations ['47777d4d-805f-4d07-8b21-c7de45ea074a', 'cb12f854-b448-452a-8f61-18ef4920e5b3', '230fd541-ee2d-4f1b-b14a-48f006c78db8', '22b74665-956c-4a07-a102-bfb35a203f47'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Delete snapshot completed successfully. Sep 28 19:05:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14376ab9-c05c-4307-8ca8-4243418ec380 tempest-SnapshotsActionsTest-386356899 None] Lock "cinder-99ec4235-c4d4-4080-8ef9-d6b531976c5f-delete_snapshot" released by "delete_snapshot" :: held 2.798s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "cinder-026315c7-4797-48ca-828b-e6e5d8227193-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Lock "cinder-026315c7-4797-48ca-828b-e6e5d8227193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "cinder-quobyte-026315c7-4797-48ca-828b-e6e5d8227193" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Lock "cinder-quobyte-026315c7-4797-48ca-828b-e6e5d8227193" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Deleting offline snapshot 026315c7-4797-48ca-828b-e6e5d8227193 of volume 64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] snapshot_file for this snap is: volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[634e92d0-f17a-40a6-85c5-75e7bec49ad0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:07 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:05:07 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:07 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.556s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[00891c4f-afe1-4871-a24a-38dbc1092b83]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:07 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 Sep 28 19:05:07 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:08 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5" returned: 0 in 0.470s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:08 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:05:08 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Flow 'volume_create_manager' (3b61d71c-9cca-4840-a9c3-359a04570e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe9d22f-b274-4ca1-b987-c69dbf8edc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe9d22f-b274-4ca1-b987-c69dbf8edc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-645214271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9654d6-4105-48f8-95a6-44dcb079831b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961e5debe00f482aba62a72e37a4d722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:08Z,use_quota=True,user_id='3da366075db246a595a0a088b764c66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced6e67d-462c-4f17-b642-c68c867ccfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced6e67d-462c-4f17-b642-c68c867ccfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e98f582-d672-4682-b9e0-88bc743ec39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e98f582-d672-4682-b9e0-88bc743ec39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d9654d6-4105-48f8-95a6-44dcb079831b', 'volume_name': 'volume-8d9654d6-4105-48f8-95a6-44dcb079831b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2ba42c-e689-472b-ba14-d13ff9a1da82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2ba42c-e689-472b-ba14-d13ff9a1da82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f925c6-312b-47f3-81de-fb0374166d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Volume 8d9654d6-4105-48f8-95a6-44dcb079831b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d9654d6-4105-48f8-95a6-44dcb079831b', 'volume_size': 1} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-645214271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9654d6-4105-48f8-95a6-44dcb079831b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961e5debe00f482aba62a72e37a4d722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:08Z,use_quota=True,user_id='3da366075db246a595a0a088b764c66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Creating volume 8d9654d6-4105-48f8-95a6-44dcb079831b {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:05:08 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:08 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b 1073741824 Sep 28 19:05:08 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:08 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.476s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:08 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193 Sep 28 19:05:08 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:09 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b 1073741824" returned: 0 in 0.575s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:09 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5.026315c7-4797-48ca-828b-e6e5d8227193" returned: 0 in 0.357s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:09 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b Sep 28 19:05:09 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Lock "cinder-quobyte-026315c7-4797-48ca-828b-e6e5d8227193" released by "_delete_snapshot" :: held 2.031s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" released by "delete_snapshot" :: held 2.065s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Created reservations ['96ba8aa5-21d0-4616-86ae-e69029f3ea78', '9ef8625b-f4a2-47ab-9f61-4211505ca4a1', '927ab58b-f582-43a6-b019-e49febf1007b', '324b31b2-55bb-47bc-8b33-a39885444b52'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Delete snapshot completed successfully. Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7b6b70f-3100-4922-b50e-813c990e78cd tempest-SnapshotsActionsTest-353721352 None] Lock "cinder-026315c7-4797-48ca-828b-e6e5d8227193-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:09 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b" returned: 0 in 0.330s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f925c6-312b-47f3-81de-fb0374166d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d9654d6-4105-48f8-95a6-44dcb079831b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6178f81-b67f-44e7-8e7f-2bd3362bb1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Volume volume-8d9654d6-4105-48f8-95a6-44dcb079831b (8d9654d6-4105-48f8-95a6-44dcb079831b): created successfully Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6178f81-b67f-44e7-8e7f-2bd3362bb1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Flow 'volume_create_manager' (3b61d71c-9cca-4840-a9c3-359a04570e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1db8e751-5643-481d-8250-2fe30b225406 tempest-AttachVolumeTestJSON-496352046 None] Created volume successfully. Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "cinder-64fefcd6-a230-41f4-bdf8-a077c62e42c5-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Flow 'volume_create_manager' (12be6e22-1d7b-4b4f-81d5-1cc40881d4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc9951e-4b97-4979-b84e-4d886739d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc9951e-4b97-4979-b84e-4d886739d631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1417529486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cd93a8-7c5d-49f8-843f-da99c1d36f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de7e3b80b7b40b5a5891f9d5cdfeff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:10Z,use_quota=True,user_id='2a1a20b76f50473aad02c96a79884859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec3c77b-3686-4c81-88dc-b7bec61260dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec3c77b-3686-4c81-88dc-b7bec61260dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebff58b3-2d8c-406c-8045-f7518dad89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebff58b3-2d8c-406c-8045-f7518dad89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98cd93a8-7c5d-49f8-843f-da99c1d36f49', 'volume_name': 'volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7308bd-fff1-4cb2-87e0-82ab49f82ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7308bd-fff1-4cb2-87e0-82ab49f82ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10bd9994-65b6-41b8-a7cb-443cf985418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Volume 98cd93a8-7c5d-49f8-843f-da99c1d36f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49', 'volume_size': 1} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1417529486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cd93a8-7c5d-49f8-843f-da99c1d36f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de7e3b80b7b40b5a5891f9d5cdfeff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:10Z,use_quota=True,user_id='2a1a20b76f50473aad02c96a79884859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Creating volume 98cd93a8-7c5d-49f8-843f-da99c1d36f49 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:05:10 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Lock "cinder-64fefcd6-a230-41f4-bdf8-a077c62e42c5-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:10 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 1073741824 Sep 28 19:05:10 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb60683-8610-4b2d-9538-c009e5dadb8c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:10 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 Sep 28 19:05:10 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:11 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 1073741824" returned: 0 in 0.670s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:11 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5" returned: 0 in 0.601s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:11 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 Sep 28 19:05:11 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:11 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5 Sep 28 19:05:11 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-27ad5fb3-d62a-4219-a8ae-46027ec47849 req-81851402-8bc0-492c-bb57-3017676ddee3 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:11 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49" returned: 0 in 0.390s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:11 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-27ad5fb3-d62a-4219-a8ae-46027ec47849 req-81851402-8bc0-492c-bb57-3017676ddee3 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.150s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-64fefcd6-a230-41f4-bdf8-a077c62e42c5" returned: 0 in 0.371s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10bd9994-65b6-41b8-a7cb-443cf985418b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6724d52f-29ce-4ea7-83b8-e019e5464f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Lock "cinder-quobyte-64fefcd6-a230-41f4-bdf8-a077c62e42c5" released by "delete_volume" :: held 1.094s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-27ad5fb3-d62a-4219-a8ae-46027ec47849 req-81851402-8bc0-492c-bb57-3017676ddee3 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.116s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Volume volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 (98cd93a8-7c5d-49f8-843f-da99c1d36f49): created successfully Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6724d52f-29ce-4ea7-83b8-e019e5464f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Flow 'volume_create_manager' (12be6e22-1d7b-4b4f-81d5-1cc40881d4cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5dde331d-3199-4140-950d-b7318d38874b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Created volume successfully. Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-27ad5fb3-d62a-4219-a8ae-46027ec47849 req-81851402-8bc0-492c-bb57-3017676ddee3 tempest-AttachVolumeTestJSON-496352046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-8d9654d6-4105-48f8-95a6-44dcb079831b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ab757ad-5fff-4d24-a2eb-66a0af573612', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:05:11 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Created reservations ['eee8755c-ae0d-4271-aab8-3727911b8ff8', '22f10396-32e0-4b26-b878-c300347930e8', '0fda2446-2689-4bfc-993a-5a3672138a20', '84eb6df4-a131-4aa8-a879-6f17976e1e78'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-27ad5fb3-d62a-4219-a8ae-46027ec47849 req-81851402-8bc0-492c-bb57-3017676ddee3 tempest-AttachVolumeTestJSON-496352046 None] attachment_update completed successfully. Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:12 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:05:12 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:12 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.318s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:05:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Deleted volume successfully. Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cd7f84c5-337b-4edc-b107-23da3e5d1a0a tempest-SnapshotsActionsTest-353721352 None] Lock "cinder-64fefcd6-a230-41f4-bdf8-a077c62e42c5-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Creating offline snapshot 366a2da6-2420-461d-8af4-5c7ffe7d6df8 of volume 98cd93a8-7c5d-49f8-843f-da99c1d36f49 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3d80fd-ba0b-49bb-b53c-af1632866920]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:13 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 Sep 28 19:05:13 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:13 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49" returned: 0 in 0.484s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:13 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 1G Sep 28 19:05:13 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:13 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 1G" returned: 0 in 0.575s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:14 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 Sep 28 19:05:14 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:14 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8" returned: 0 in 0.416s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:14 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 is being set with open permissions: ugo+rw Sep 28 19:05:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:14 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 Sep 28 19:05:14 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:14 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8" returned: 0 in 0.323s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:14 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.info Sep 28 19:05:14 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-05a935ba-473b-4e51-9441-606c6d9191b8 req-a668bb4d-3616-4702-929f-6d773e40b494 tempest-AttachVolumeTestJSON-496352046 None] Terminate volume connection completed successfully. Sep 28 19:05:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-05a935ba-473b-4e51-9441-606c6d9191b8 req-a668bb4d-3616-4702-929f-6d773e40b494 tempest-AttachVolumeTestJSON-496352046 None] Deleting attachment a6c43226-b96f-4d41-8f91-2868b5df82cd. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:05:15 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.info" returned: 0 in 0.354s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:15 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.info is being set with open permissions: ugo+rw Sep 28 19:05:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:15 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.info Sep 28 19:05:15 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:15 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.info" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cefe5526-c6f3-42f0-805b-bd735406ec2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Create snapshot completed successfully Sep 28 19:05:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-f8a484e3-adde-4742-a080-195bab724557 req-72464053-edd4-49bb-b1b1-7ecd98cbc2a1 tempest-AttachVolumeTestJSON-496352046 None] Terminate volume connection completed successfully. Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-f8a484e3-adde-4742-a080-195bab724557 req-72464053-edd4-49bb-b1b1-7ecd98cbc2a1 tempest-AttachVolumeTestJSON-496352046 None] Deleting attachment 0ab757ad-5fff-4d24-a2eb-66a0af573612. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Acquiring lock "cinder-366a2da6-2420-461d-8af4-5c7ffe7d6df8-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "cinder-366a2da6-2420-461d-8af4-5c7ffe7d6df8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Acquiring lock "cinder-quobyte-98cd93a8-7c5d-49f8-843f-da99c1d36f49" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "cinder-quobyte-98cd93a8-7c5d-49f8-843f-da99c1d36f49" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Acquiring lock "cinder-quobyte-366a2da6-2420-461d-8af4-5c7ffe7d6df8" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "cinder-quobyte-366a2da6-2420-461d-8af4-5c7ffe7d6df8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Deleting offline snapshot 366a2da6-2420-461d-8af4-5c7ffe7d6df8 of volume 98cd93a8-7c5d-49f8-843f-da99c1d36f49 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] snapshot_file for this snap is: volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21ad777-6fbe-48ac-84ed-3358189bdd88]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:16 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 Sep 28 19:05:16 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:17 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8" returned: 0 in 0.495s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:05:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[423db9b3-ceb9-40b3-b6aa-6a759b826932]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:17 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 Sep 28 19:05:17 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:17 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49" returned: 0 in 0.478s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:17 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 Sep 28 19:05:17 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:18 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8" returned: 0 in 0.585s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:18 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8 Sep 28 19:05:18 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:18 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49.366a2da6-2420-461d-8af4-5c7ffe7d6df8" returned: 0 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "cinder-quobyte-366a2da6-2420-461d-8af4-5c7ffe7d6df8" released by "_delete_snapshot" :: held 2.111s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "cinder-quobyte-98cd93a8-7c5d-49f8-843f-da99c1d36f49" released by "delete_snapshot" :: held 2.143s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:18 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Created reservations ['6f5795d1-1dff-47e9-bf91-8d8987df11dd', '5f1c0607-098f-44ad-84e3-5df58749555e', '4de6c5b4-dfde-40c3-8d70-cd18b8f1803d', '79a923fc-fbae-4a73-a716-62b14448f284'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Delete snapshot completed successfully. Sep 28 19:05:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bcca1f43-d2e7-423b-a1e1-5a46fa8eab1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "cinder-366a2da6-2420-461d-8af4-5c7ffe7d6df8-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Acquiring lock "cinder-98cd93a8-7c5d-49f8-843f-da99c1d36f49-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "cinder-98cd93a8-7c5d-49f8-843f-da99c1d36f49-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Acquiring lock "cinder-quobyte-98cd93a8-7c5d-49f8-843f-da99c1d36f49" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "cinder-quobyte-98cd93a8-7c5d-49f8-843f-da99c1d36f49" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[28edcdae-705b-484c-a8e6-99c223e8bd0d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:20 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 Sep 28 19:05:20 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:20 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49" returned: 0 in 0.468s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:20 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49 Sep 28 19:05:20 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:20 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98cd93a8-7c5d-49f8-843f-da99c1d36f49" returned: 0 in 0.277s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "cinder-quobyte-98cd93a8-7c5d-49f8-843f-da99c1d36f49" released by "delete_volume" :: held 0.828s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:20 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Created reservations ['37cd0f1d-cd2c-4fbd-a2b4-19f1c9251f1e', 'd6bc910e-a196-411e-957f-34b80c5ac517', '51109a10-efb0-4b4a-99cb-0ac27ea6dd97', '393a938b-a712-42ef-a6bf-512de3e8d34d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:21 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:05:21 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:21 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:05:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Deleted volume successfully. Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eaacd362-d174-4298-8a71-6f79388b8550 tempest-VolumeSnapshotQuotasNegativeTestJSON-1272151702 None] Lock "cinder-98cd93a8-7c5d-49f8-843f-da99c1d36f49-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Flow 'volume_create_manager' (27745088-374d-4fe6-be05-1c121f6f3dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2f6740-3c95-4b54-a6a9-650f42bab781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2f6740-3c95-4b54-a6a9-650f42bab781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-100458388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b79c08d-0d55-4e82-8775-bb00a3722a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83447a8a302e4f5ab98656b568de7ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:21Z,use_quota=True,user_id='a410ef47ccd74a5f80a618b3f67c48ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b66cc24-d395-4207-bfb4-9bf9c695b04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b66cc24-d395-4207-bfb4-9bf9c695b04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e989d9e1-a914-44ff-a6a8-4932fa1470aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e989d9e1-a914-44ff-a6a8-4932fa1470aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b79c08d-0d55-4e82-8775-bb00a3722a50', 'volume_name': 'volume-2b79c08d-0d55-4e82-8775-bb00a3722a50', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfb66cc-4871-4836-9b88-5fe50a14a9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfb66cc-4871-4836-9b88-5fe50a14a9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7762570b-62ff-4282-922c-2458ad28d43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:21 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Volume 2b79c08d-0d55-4e82-8775-bb00a3722a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b79c08d-0d55-4e82-8775-bb00a3722a50', 'volume_size': 1} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-100458388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b79c08d-0d55-4e82-8775-bb00a3722a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83447a8a302e4f5ab98656b568de7ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:21Z,use_quota=True,user_id='a410ef47ccd74a5f80a618b3f67c48ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Creating volume 2b79c08d-0d55-4e82-8775-bb00a3722a50 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:05:21 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:05:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:21 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50 1073741824 Sep 28 19:05:21 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:22 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50 1073741824" returned: 0 in 0.651s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:22 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50 Sep 28 19:05:22 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:22 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50" returned: 0 in 0.315s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:05:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7762570b-62ff-4282-922c-2458ad28d43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b79c08d-0d55-4e82-8775-bb00a3722a50', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05181168-7a84-451b-86fa-5b885b2f64bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:22 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Volume volume-2b79c08d-0d55-4e82-8775-bb00a3722a50 (2b79c08d-0d55-4e82-8775-bb00a3722a50): created successfully Sep 28 19:05:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05181168-7a84-451b-86fa-5b885b2f64bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Flow 'volume_create_manager' (27745088-374d-4fe6-be05-1c121f6f3dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-42cfdfea-7438-4e45-b16a-f8520007b2dd tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Created volume successfully. Sep 28 19:05:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "cinder-8d9654d6-4105-48f8-95a6-44dcb079831b-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-8d9654d6-4105-48f8-95a6-44dcb079831b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "cinder-quobyte-8d9654d6-4105-48f8-95a6-44dcb079831b" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-quobyte-8d9654d6-4105-48f8-95a6-44dcb079831b" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fc6242-04c9-4933-bb85-95ac1622809b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:23 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b Sep 28 19:05:24 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:24 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:24 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b Sep 28 19:05:24 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:24 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8d9654d6-4105-48f8-95a6-44dcb079831b" returned: 0 in 0.346s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-quobyte-8d9654d6-4105-48f8-95a6-44dcb079831b" released by "delete_volume" :: held 0.931s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Created reservations ['4daf38ab-e1ad-435c-90c7-d0baf0d708cb', 'ce391f56-fc7c-423c-908c-81b512ac2729', '5b7ae496-62fd-4f9e-8578-8813d1db4ee5', '987bd06e-9df8-4664-a644-37825d3f1886'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:24 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:05:24 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Acquiring lock "cinder-2b79c08d-0d55-4e82-8775-bb00a3722a50-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Lock "cinder-2b79c08d-0d55-4e82-8775-bb00a3722a50-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Acquiring lock "cinder-quobyte-2b79c08d-0d55-4e82-8775-bb00a3722a50" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Lock "cinder-quobyte-2b79c08d-0d55-4e82-8775-bb00a3722a50" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f930619-220d-473e-8e68-7e430b3f0caa]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:25 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50 Sep 28 19:05:25 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:25 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.392s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:05:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Deleted volume successfully. Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d9f905c3-6e86-40f2-a4bd-2ce22cfe4bf6 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-8d9654d6-4105-48f8-95a6-44dcb079831b-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:25 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50" returned: 0 in 0.394s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:25 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50 Sep 28 19:05:25 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:25 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2b79c08d-0d55-4e82-8775-bb00a3722a50" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Lock "cinder-quobyte-2b79c08d-0d55-4e82-8775-bb00a3722a50" released by "delete_volume" :: held 0.720s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Created reservations ['1769a350-3d58-4808-9615-e6166c4ba86a', '7debb1fb-7615-4d52-bd7b-24a2626003aa', '5ba0799a-6a40-4b5a-a1ca-d81206e70a04', '30fde3df-0010-4359-8cf7-4047009ffdf7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "cinder-cf18f4fd-367b-41f5-a7ad-1d590a5b064c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-cf18f4fd-367b-41f5-a7ad-1d590a5b064c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:26 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:05:26 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "cinder-quobyte-cf18f4fd-367b-41f5-a7ad-1d590a5b064c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-quobyte-cf18f4fd-367b-41f5-a7ad-1d590a5b064c" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f1c4e3-ac2f-430b-8f7a-347e0afdf602]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:26 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c Sep 28 19:05:26 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:26 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.362s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:05:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Deleted volume successfully. Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26d08de8-5fcb-4e1e-987c-e762222ae013 tempest-VolumeQuotasNegativeTestJSON-1237755294 None] Lock "cinder-2b79c08d-0d55-4e82-8775-bb00a3722a50-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:26 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c" returned: 0 in 0.471s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:26 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c Sep 28 19:05:26 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:26 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-cf18f4fd-367b-41f5-a7ad-1d590a5b064c" returned: 0 in 0.286s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-quobyte-cf18f4fd-367b-41f5-a7ad-1d590a5b064c" released by "delete_volume" :: held 0.820s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Created reservations ['4d56cfe5-118b-463e-94b5-2f2b33c6b9ef', '18be4a86-93c6-406d-ba12-ce0f5875f414', 'f80d55d0-e06f-4708-97a4-98f9fd418587', '2cf526bd-b8f2-4274-82fc-a07eb006bfe7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:27 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:05:27 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "cinder-802a80e7-c571-4b41-af44-b16ea2f1c997-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-802a80e7-c571-4b41-af44-b16ea2f1c997-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "cinder-quobyte-802a80e7-c571-4b41-af44-b16ea2f1c997" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-quobyte-802a80e7-c571-4b41-af44-b16ea2f1c997" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f44e4ee-8e36-4c54-a89e-f9d8b721e20c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:27 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.497s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:05:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Deleted volume successfully. Sep 28 19:05:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3388a11d-bd97-411b-b509-313890720dd8 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-cf18f4fd-367b-41f5-a7ad-1d590a5b064c-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:27 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997 Sep 28 19:05:27 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:28 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997" returned: 0 in 0.624s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:28 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997 Sep 28 19:05:28 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:28 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-802a80e7-c571-4b41-af44-b16ea2f1c997" returned: 0 in 0.391s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-quobyte-802a80e7-c571-4b41-af44-b16ea2f1c997" released by "delete_volume" :: held 1.097s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Created reservations ['2c0d742d-e07a-40f7-a9cc-0288faa47d38', '39a5d728-4713-402e-bbe3-f12c22108bf0', 'ee3391f7-3df6-4a29-b09d-700cc0cd5cf5', '9d0137eb-b419-4ad3-8111-e0734845d99a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:29 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:05:29 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-def7992a-225f-4553-b7cb-4b749a1c5038 req-d4e396da-1d47-4dca-bb50-5a5f271f9131 tempest-ServerActionsTestOtherA-1124315465 None] Terminate volume connection completed successfully. Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-def7992a-225f-4553-b7cb-4b749a1c5038 req-d4e396da-1d47-4dca-bb50-5a5f271f9131 tempest-ServerActionsTestOtherA-1124315465 None] Deleting attachment 38771c26-d96d-4a4d-818b-23d77e7ce7b6. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:05:29 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:05:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Deleted volume successfully. Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64e6b3cc-8215-4f8a-80fd-9c58b4d206d5 tempest-AttachVolumeTestJSON-496352046 None] Lock "cinder-802a80e7-c571-4b41-af44-b16ea2f1c997-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Flow 'volume_create_manager' (3d9ffa90-96af-42a4-8353-b7860cfe1de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c37645-1efa-4e5a-80d0-572e7856581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c37645-1efa-4e5a-80d0-572e7856581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-576681004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2699a8da38442d09554f1c4097afcec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:30Z,use_quota=True,user_id='0a1c65fb0a33437facd537a339cf74a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbbf30f-667e-43d7-be1e-02696b246b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbbf30f-667e-43d7-be1e-02696b246b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8a569f-9572-4b28-ab31-c7aa885033c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:29 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 19:05:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8a569f-9572-4b28-ab31-c7aa885033c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c', 'volume_name': 'volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d34c53c-ad3a-4027-b957-a88acdbf2bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d34c53c-ad3a-4027-b957-a88acdbf2bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d61bb2-3a1a-431f-aa76-884889e7a0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Volume 1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 19:05:31 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Trying to clone 1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c from image 62ee51ad-b6ed-458d-a726-fccffd745d46 at location (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 19:05:31 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 19:05:31 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Image download 20.69 MB at 20.69 MB/s Sep 28 19:05:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[815a2e8c-9ec1-4f64-a996-f5442decdeaa]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:31 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD Sep 28 19:05:31 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:32 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Temporary image 62ee51ad-b6ed-458d-a726-fccffd745d46 is fetched for user 0a1c65fb0a33437facd537a339cf74a2. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=140,cinder:UPDATE=122,cinder:INSERT=31,cinder:DELETE=10 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=111,cinder:UPDATE=120,cinder:INSERT=29,cinder:DELETE=9 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe26301e-5db3-468d-b663-b724cbfea09a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:32 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD Sep 28 19:05:32 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:32 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD" returned: 0 in 0.526s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-576681004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2699a8da38442d09554f1c4097afcec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:30Z,use_quota=True,user_id='0a1c65fb0a33437facd537a339cf74a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Creating volume 1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:05:32 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:05:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:32 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c 1073741824 Sep 28 19:05:32 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:33 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c 1073741824" returned: 0 in 0.745s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:33 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c Sep 28 19:05:33 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:33 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c" returned: 0 in 0.394s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:05:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Attempting download of 62ee51ad-b6ed-458d-a726-fccffd745d46 ((None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}])) to volume 1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70457f0-faeb-4365-8fa0-1e614eb50779]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_n6nh06ae {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:34 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_n6nh06ae Sep 28 19:05:34 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:34 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_n6nh06ae" returned: 0 in 0.471s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_n6nh06ae {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:34 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:05:34 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:34 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_n6nh06ae Sep 28 19:05:34 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:34 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.393s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:05:35 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_n6nh06ae" returned: 1 in 0.603s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_n6nh06ae' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea60f68-f1c7-4fb3-9b0d-3c451e30a18b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:35 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD Sep 28 19:05:35 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:35 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD" returned: 0 in 0.459s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] 62ee51ad-b6ed-458d-a726-fccffd745d46 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 19:05:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:35 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c Sep 28 19:05:35 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Flow 'volume_create_manager' (39fb35e3-2992-4ebc-84c3-102a4bb39708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8528db62-615c-4f07-b7b7-4dcfec4cd443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8528db62-615c-4f07-b7b7-4dcfec4cd443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1207519637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a0b452bb1e41659d5e4c24ba8b602b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:38Z,use_quota=True,user_id='ddbd3c35efed478f8d5dae97ce3f7c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f211edcb-5e11-4c4c-800a-53950c49e005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f211edcb-5e11-4c4c-800a-53950c49e005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06bfddd-50b6-40a5-93f4-9cefb170ffcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Flow 'volume_create_manager' (c4ba663f-7113-461d-8017-e72ebf368ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bb9464-05fb-4f74-b345-c08abd28c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bb9464-05fb-4f74-b345-c08abd28c046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-969478220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4f3ef1-5655-4a28-84e4-c331da8290ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a37ea8d78bf47fe982a4eb3dbb632b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:38Z,use_quota=True,user_id='3767d43ff588418686152caf551435ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd8a9df-6ee8-4237-851b-4f248429d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd8a9df-6ee8-4237-851b-4f248429d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf68805-cb51-4c0a-b802-5e14cbaf16fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf68805-cb51-4c0a-b802-5e14cbaf16fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac4f3ef1-5655-4a28-84e4-c331da8290ff', 'volume_name': 'volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e81efb-ddf4-459d-8d25-752784f7782e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e81efb-ddf4-459d-8d25-752784f7782e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8b4ac3-a5e7-4156-bb83-4ade6728989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Volume ac4f3ef1-5655-4a28-84e4-c331da8290ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff', 'volume_size': 1} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-969478220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4f3ef1-5655-4a28-84e4-c331da8290ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a37ea8d78bf47fe982a4eb3dbb632b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:38Z,use_quota=True,user_id='3767d43ff588418686152caf551435ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Creating volume ac4f3ef1-5655-4a28-84e4-c331da8290ff {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:05:38 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:38 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff 1073741824 Sep 28 19:05:38 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06bfddd-50b6-40a5-93f4-9cefb170ffcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20', 'volume_name': 'volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f46722-ddb6-4dd6-b9a6-85f0f68efdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f46722-ddb6-4dd6-b9a6-85f0f68efdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ced922d-ae8f-4272-b16e-a56b41aa0089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Volume 3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Trying to clone 3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 from image 62ee51ad-b6ed-458d-a726-fccffd745d46 at location (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 19:05:38 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c" returned: 0 in 3.061s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_k_epd517devstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:05:38 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Converted 112.00 MB image at 36.58 MB/s Sep 28 19:05:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:38 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c 1G Sep 28 19:05:38 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:39 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff 1073741824" returned: 0 in 0.787s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 19:05:39 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Image download 20.69 MB at 20.69 MB/s Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d93084-7660-4bb0-8589-6f204111abe4]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:39 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff Sep 28 19:05:39 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:39 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c 1G" returned: 0 in 0.636s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Downloaded image 62ee51ad-b6ed-458d-a726-fccffd745d46 ((None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}])) to volume 1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Temporary image 62ee51ad-b6ed-458d-a726-fccffd745d46 for user 0a1c65fb0a33437facd537a339cf74a2 is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Marking volume 1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 19:05:39 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD Sep 28 19:05:39 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Copying metadata from image 62ee51ad-b6ed-458d-a726-fccffd745d46 to 1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Creating volume glance metadata for volume 1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c backed by image 62ee51ad-b6ed-458d-a726-fccffd745d46 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d61bb2-3a1a-431f-aa76-884889e7a0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1597e73-4312-4783-8fd9-79684fe3c9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:39 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Volume volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c (1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c): created successfully Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1597e73-4312-4783-8fd9-79684fe3c9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Flow 'volume_create_manager' (3d9ffa90-96af-42a4-8353-b7860cfe1de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-907984b1-9652-4f70-8d7f-c554c29f2500 tempest-VolumesImageMetadata-1510444821 None] Created volume successfully. Sep 28 19:05:39 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8b4ac3-a5e7-4156-bb83-4ade6728989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd878d2c-0404-4796-9f21-f89c1fb5735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:39 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Volume volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff (ac4f3ef1-5655-4a28-84e4-c331da8290ff): created successfully Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd878d2c-0404-4796-9f21-f89c1fb5735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Flow 'volume_create_manager' (c4ba663f-7113-461d-8017-e72ebf368ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9fb38b67-931d-4fa6-b2e4-9dab006cecc4 tempest-VolumesServicesTestJSON-1327412737 None] Created volume successfully. Sep 28 19:05:39 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Temporary image 62ee51ad-b6ed-458d-a726-fccffd745d46 is fetched for user ddbd3c35efed478f8d5dae97ce3f7c2f. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9965c2f8-e7f7-4681-b4e3-15f0824e9ae8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:39 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD Sep 28 19:05:39 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:40 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1207519637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a0b452bb1e41659d5e4c24ba8b602b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:38Z,use_quota=True,user_id='ddbd3c35efed478f8d5dae97ce3f7c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Creating volume 3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:05:40 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Acquiring lock "cinder-ac4f3ef1-5655-4a28-84e4-c331da8290ff-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:40 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 1073741824 Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Lock "cinder-ac4f3ef1-5655-4a28-84e4-c331da8290ff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:40 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Acquiring lock "cinder-quobyte-ac4f3ef1-5655-4a28-84e4-c331da8290ff" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Lock "cinder-quobyte-ac4f3ef1-5655-4a28-84e4-c331da8290ff" acquired by "delete_volume" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[34db0210-edad-47a5-80ba-f52d08ee7dc6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:40 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff Sep 28 19:05:40 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Acquiring lock "cinder-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Lock "cinder-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Acquiring lock "cinder-quobyte-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Lock "cinder-quobyte-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af7e8c8-13c0-422a-888c-72712f6dab1b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:41 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 1073741824" returned: 0 in 0.774s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:41 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff" returned: 0 in 0.600s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:41 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c Sep 28 19:05:41 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:41 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff Sep 28 19:05:41 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:41 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 Sep 28 19:05:41 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:41 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20" returned: 0 in 0.306s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:41 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ac4f3ef1-5655-4a28-84e4-c331da8290ff" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:41 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Lock "cinder-quobyte-ac4f3ef1-5655-4a28-84e4-c331da8290ff" released by "delete_volume" :: held 1.034s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c" returned: 0 in 0.523s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Attempting download of 62ee51ad-b6ed-458d-a726-fccffd745d46 ((None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}])) to volume 3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 19:05:41 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c Sep 28 19:05:41 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c8759-f67e-4cfa-8c54-ec1107cc41e2]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_901k9lnt {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Created reservations ['22c56a0a-6ea2-427a-8cb8-d59e006b5bc1', '9ce4b82d-17dc-4da8-9a9a-9c0bc67a6731', '455f6df3-4e0b-4efc-8442-5b0dabcf9ef8', '9486a802-0dd4-4068-a328-b78eac7ac79c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:41 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_901k9lnt Sep 28 19:05:41 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:41 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:05:41 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:41 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Lock "cinder-quobyte-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c" released by "delete_volume" :: held 0.945s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:41 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Created reservations ['b88be07e-bf2a-466a-ac70-6263a72b9fdb', '4cbd1bb6-4ad0-4f58-bc2f-4d836ef3dd37', '94c761d9-35bf-4480-b3a3-a1817ebb569f', '5503c482-d2e6-4b34-9f61-2db1c9120260'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:05:42 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_901k9lnt" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_901k9lnt {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:42 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:05:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Deleted volume successfully. Sep 28 19:05:42 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:05:42 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca7adf4a-cedd-48f8-9465-05ab9676cb0a tempest-VolumesServicesTestJSON-1327412737 None] Lock "cinder-ac4f3ef1-5655-4a28-84e4-c331da8290ff-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:42 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_901k9lnt Sep 28 19:05:42 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:42 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:42 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_901k9lnt" returned: 1 in 0.448s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_901k9lnt' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae077471-be51-4056-ac05-fb2b72016d61]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:05:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Deleted volume successfully. Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae04752d-b188-4d84-a851-3b441938daeb tempest-VolumesImageMetadata-1510444821 None] Lock "cinder-1bf6f2b5-00f2-44ac-853b-b4b2b5bbde2c-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:05:42 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD Sep 28 19:05:42 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:42 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] 62ee51ad-b6ed-458d-a726-fccffd745d46 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 19:05:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:42 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 Sep 28 19:05:42 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:45 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20" returned: 0 in 2.799s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:45 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_3fv45tejdevstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:05:45 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Converted 112.00 MB image at 39.99 MB/s Sep 28 19:05:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:45 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 1G Sep 28 19:05:45 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:46 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 1G" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:46 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Downloaded image 62ee51ad-b6ed-458d-a726-fccffd745d46 ((None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}])) to volume 3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 19:05:46 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Temporary image 62ee51ad-b6ed-458d-a726-fccffd745d46 for user ddbd3c35efed478f8d5dae97ce3f7c2f is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 19:05:46 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Marking volume 3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 19:05:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Copying metadata from image 62ee51ad-b6ed-458d-a726-fccffd745d46 to 3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 19:05:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Creating volume glance metadata for volume 3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 backed by image 62ee51ad-b6ed-458d-a726-fccffd745d46 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 19:05:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ced922d-ae8f-4272-b16e-a56b41aa0089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9aee13-0320-4cf7-aea1-c512bc30ab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Volume volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 (3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20): created successfully Sep 28 19:05:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9aee13-0320-4cf7-aea1-c512bc30ab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Flow 'volume_create_manager' (39fb35e3-2992-4ebc-84c3-102a4bb39708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-40cf1273-d503-43fd-9a21-458cb259091d tempest-ServerActionsTestOtherA-1124315465 None] Created volume successfully. Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Flow 'volume_create_manager' (845ac1e5-c70c-4494-bf72-6be9e2cf3b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7ff7d6-1e5a-459e-88eb-1818015acbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7ff7d6-1e5a-459e-88eb-1818015acbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1137373297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d6ae9f-1594-40a5-9720-47c0c33ccfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c204b4bdb5224c86b4c45c8ee076e24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:50Z,use_quota=True,user_id='d9cba12ae4774739a2d4bb0670224d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2c2887-7ba4-4a61-b681-43f942d1c9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2c2887-7ba4-4a61-b681-43f942d1c9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdbf54bf-84ea-435e-9667-26b2c09bfa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdbf54bf-84ea-435e-9667-26b2c09bfa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d6ae9f-1594-40a5-9720-47c0c33ccfd7', 'volume_name': 'volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b757f3c-6ec2-4b01-ab38-f1482d286bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b757f3c-6ec2-4b01-ab38-f1482d286bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114b9548-c889-404c-b3e0-3755d0ecfca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Volume 67d6ae9f-1594-40a5-9720-47c0c33ccfd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7', 'volume_size': 1} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1137373297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d6ae9f-1594-40a5-9720-47c0c33ccfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c204b4bdb5224c86b4c45c8ee076e24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:05:50Z,use_quota=True,user_id='d9cba12ae4774739a2d4bb0670224d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Creating volume 67d6ae9f-1594-40a5-9720-47c0c33ccfd7 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:05:49 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:05:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:49 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 1073741824 Sep 28 19:05:49 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:50 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 1073741824" returned: 0 in 0.783s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:50 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 Sep 28 19:05:50 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:50 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" returned: 0 in 0.379s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:05:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114b9548-c889-404c-b3e0-3755d0ecfca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fda4d83-b1fd-4220-a953-c0a63f318865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:05:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Volume volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 (67d6ae9f-1594-40a5-9720-47c0c33ccfd7): created successfully Sep 28 19:05:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fda4d83-b1fd-4220-a953-c0a63f318865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:05:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Flow 'volume_create_manager' (845ac1e5-c70c-4494-bf72-6be9e2cf3b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:05:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-073217cc-d3b7-41f7-9a33-b762398caed3 tempest-SnapshotMetadataTestJSON-983339714 None] Created volume successfully. Sep 28 19:05:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-287c99f0-cf15-4e41-913a-d08948b6c26a req-3ca36124-9e40-41f4-b56a-088d8e3fdb6f tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-287c99f0-cf15-4e41-913a-d08948b6c26a req-3ca36124-9e40-41f4-b56a-088d8e3fdb6f tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-287c99f0-cf15-4e41-913a-d08948b6c26a req-3ca36124-9e40-41f4-b56a-088d8e3fdb6f tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.079s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-287c99f0-cf15-4e41-913a-d08948b6c26a req-3ca36124-9e40-41f4-b56a-088d8e3fdb6f tempest-ServerActionsTestOtherA-1124315465 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e28f3b81-3715-463f-a9f0-62875385a6b7', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:05:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-287c99f0-cf15-4e41-913a-d08948b6c26a req-3ca36124-9e40-41f4-b56a-088d8e3fdb6f tempest-ServerActionsTestOtherA-1124315465 None] attachment_update completed successfully. Sep 28 19:05:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:05:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:05:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Creating offline snapshot 4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 of volume 67d6ae9f-1594-40a5-9720-47c0c33ccfd7 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:05:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f446bbde-7cbd-44e3-aa90-13dd03e3f9a9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:53 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 Sep 28 19:05:53 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:53 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" returned: 0 in 0.542s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:53 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 1G Sep 28 19:05:53 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:54 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 1G" returned: 0 in 0.664s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:54 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 Sep 28 19:05:54 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:54 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2" returned: 0 in 0.525s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:54 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 is being set with open permissions: ugo+rw Sep 28 19:05:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:54 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 Sep 28 19:05:54 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:54 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2" returned: 0 in 0.336s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:55 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.info Sep 28 19:05:55 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.info" returned: 0 in 0.442s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:55 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.info is being set with open permissions: ugo+rw Sep 28 19:05:55 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:55 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.info Sep 28 19:05:55 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:55 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.info" returned: 0 in 0.409s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.171s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:05:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a313360e-1fe7-4ea3-9414-80eacdb3ffde tempest-SnapshotMetadataTestJSON-983339714 None] Create snapshot completed successfully Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Acquiring lock "cinder-4c4bfc7f-5870-493d-8fb6-024d5c1eeca2-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Lock "cinder-4c4bfc7f-5870-493d-8fb6-024d5c1eeca2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Acquiring lock "cinder-quobyte-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Lock "cinder-quobyte-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Acquiring lock "cinder-quobyte-4c4bfc7f-5870-493d-8fb6-024d5c1eeca2" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Lock "cinder-quobyte-4c4bfc7f-5870-493d-8fb6-024d5c1eeca2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Deleting offline snapshot 4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 of volume 67d6ae9f-1594-40a5-9720-47c0c33ccfd7 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] snapshot_file for this snap is: volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab2f653-7973-403d-ba38-cdff5c0194d9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:59 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 Sep 28 19:05:59 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:05:59 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2" returned: 0 in 0.548s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f07f0b-f9b2-4fb1-bf7d-1a9ec85f734f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:05:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:05:59 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 Sep 28 19:05:59 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:00 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" returned: 0 in 0.605s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:00 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 Sep 28 19:06:00 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:01 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2" returned: 0 in 0.750s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:01 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2 Sep 28 19:06:01 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:01 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7.4c4bfc7f-5870-493d-8fb6-024d5c1eeca2" returned: 0 in 0.539s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Lock "cinder-quobyte-4c4bfc7f-5870-493d-8fb6-024d5c1eeca2" released by "_delete_snapshot" :: held 2.668s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Lock "cinder-quobyte-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" released by "delete_snapshot" :: held 2.715s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:01 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Created reservations ['45a02799-7a28-4990-8706-9d14030c19cf', '9bd894c0-3206-4bee-8ee5-802bd2f8c8d7', '03375237-7ba0-48cf-870c-d1d7dbee90fa', 'e78ac8f3-12f6-4f74-82b6-b978a39aba6b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Delete snapshot completed successfully. Sep 28 19:06:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a04920c0-c34b-4a39-8208-a129636030e1 tempest-SnapshotMetadataTestJSON-983339714 None] Lock "cinder-4c4bfc7f-5870-493d-8fb6-024d5c1eeca2-delete_snapshot" released by "delete_snapshot" :: held 3.020s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Acquiring lock "cinder-67d6ae9f-1594-40a5-9720-47c0c33ccfd7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Lock "cinder-67d6ae9f-1594-40a5-9720-47c0c33ccfd7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Acquiring lock "cinder-quobyte-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Lock "cinder-quobyte-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" acquired by "delete_volume" :: waited 0.058s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3957191c-62b2-4b5f-8413-85165c8926be]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:03 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 Sep 28 19:06:03 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:03 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" returned: 0 in 0.690s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:03 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7 Sep 28 19:06:03 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:04 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" returned: 0 in 0.704s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Lock "cinder-quobyte-67d6ae9f-1594-40a5-9720-47c0c33ccfd7" released by "delete_volume" :: held 1.521s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Created reservations ['4626c8a6-17ab-4be0-b6e2-c5da7d33f089', '4fe546f6-3e94-4356-981a-bcae6826cfba', '64c77610-3ea7-45a7-a3d0-38a67be18c80', '0c3717e2-701f-43a6-b2b8-8d26d7965707'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:04 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:06:04 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:05 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.524s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:05 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:06:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Deleted volume successfully. Sep 28 19:06:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7a26d893-df04-4878-b78b-42bc379e048e tempest-SnapshotMetadataTestJSON-983339714 None] Lock "cinder-67d6ae9f-1594-40a5-9720-47c0c33ccfd7-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-3623f222-812f-4213-b386-25216ba15cba req-797c5b4e-ddb7-4313-b8c9-1eee408422f7 tempest-ServerActionsTestOtherA-1124315465 None] Terminate volume connection completed successfully. Sep 28 19:06:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-3623f222-812f-4213-b386-25216ba15cba req-797c5b4e-ddb7-4313-b8c9-1eee408422f7 tempest-ServerActionsTestOtherA-1124315465 None] Deleting attachment e28f3b81-3715-463f-a9f0-62875385a6b7. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:06:15 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=54,cinder:INSERT=24,cinder:SELECT=45,cinder:DELETE=5 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:06:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-3623f222-812f-4213-b386-25216ba15cba req-a23bcc5b-c84b-4e7b-9452-9783419bdfcd tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-3623f222-812f-4213-b386-25216ba15cba req-a23bcc5b-c84b-4e7b-9452-9783419bdfcd tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-3623f222-812f-4213-b386-25216ba15cba req-a23bcc5b-c84b-4e7b-9452-9783419bdfcd tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-3623f222-812f-4213-b386-25216ba15cba req-a23bcc5b-c84b-4e7b-9452-9783419bdfcd tempest-ServerActionsTestOtherA-1124315465 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e2a8820-8613-463c-bb2e-d6029d0d62f4', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:06:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-3623f222-812f-4213-b386-25216ba15cba req-a23bcc5b-c84b-4e7b-9452-9783419bdfcd tempest-ServerActionsTestOtherA-1124315465 None] attachment_update completed successfully. Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Flow 'volume_create_manager' (3f7490f7-7747-4fde-880a-82b86b1506b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c77c1a-bf44-4f61-891f-bdbe031649c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c77c1a-bf44-4f61-891f-bdbe031649c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1871109269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acde06e-9846-487c-851c-2825b0eb0eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d5afd059bb4b88a86fa1bd085bb249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:06:23Z,use_quota=True,user_id='3a94f5981fc146d5b8f26e7422e74dcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18005875-d624-4976-ba1d-b506cc923af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18005875-d624-4976-ba1d-b506cc923af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2394a819-c9eb-4856-91ad-d0adf4112db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2394a819-c9eb-4856-91ad-d0adf4112db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9acde06e-9846-487c-851c-2825b0eb0eec', 'volume_name': 'volume-9acde06e-9846-487c-851c-2825b0eb0eec', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e33449-b3e0-4f29-bfa4-ef1b5a3f7fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e33449-b3e0-4f29-bfa4-ef1b5a3f7fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03defe68-ec34-4d70-ac5e-fe33c3d61eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Volume 9acde06e-9846-487c-851c-2825b0eb0eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9acde06e-9846-487c-851c-2825b0eb0eec', 'volume_size': 1} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1871109269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acde06e-9846-487c-851c-2825b0eb0eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d5afd059bb4b88a86fa1bd085bb249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:06:23Z,use_quota=True,user_id='3a94f5981fc146d5b8f26e7422e74dcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Creating volume 9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:06:23 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:06:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:23 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec 1073741824 Sep 28 19:06:23 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:24 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec 1073741824" returned: 0 in 0.933s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:24 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec Sep 28 19:06:24 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:24 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:06:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03defe68-ec34-4d70-ac5e-fe33c3d61eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9acde06e-9846-487c-851c-2825b0eb0eec', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeaa3079-40ae-4afa-abcb-1332b551a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:24 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Volume volume-9acde06e-9846-487c-851c-2825b0eb0eec (9acde06e-9846-487c-851c-2825b0eb0eec): created successfully Sep 28 19:06:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeaa3079-40ae-4afa-abcb-1332b551a330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Flow 'volume_create_manager' (3f7490f7-7747-4fde-880a-82b86b1506b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:06:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3302a1f3-3a35-4580-9324-e52b4baec7a8 tempest-VolumesSnapshotListTestJSON-205094583 None] Created volume successfully. Sep 28 19:06:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Creating offline snapshot 2b15d959-1c1d-4a24-bf85-1a594531b45b of volume 9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:06:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5c6a2f-76f2-47d4-b30d-eac248f3f151]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:26 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec Sep 28 19:06:26 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:26 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec" returned: 0 in 0.835s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:26 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b 1G Sep 28 19:06:26 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:27 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b 1G" returned: 0 in 0.909s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acde06e-9846-487c-851c-2825b0eb0eec -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:27 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acde06e-9846-487c-851c-2825b0eb0eec -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b Sep 28 19:06:27 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:28 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acde06e-9846-487c-851c-2825b0eb0eec -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b" returned: 0 in 0.568s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:28 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b is being set with open permissions: ugo+rw Sep 28 19:06:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:28 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b Sep 28 19:06:28 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:28 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b" returned: 0 in 0.422s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:28 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.info Sep 28 19:06:28 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:29 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.info" returned: 0 in 0.609s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:29 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.info is being set with open permissions: ugo+rw Sep 28 19:06:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:29 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.info Sep 28 19:06:29 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:29 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.info" returned: 0 in 0.460s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-04e47dcd-8cc3-4045-a36d-ebd249246f95 tempest-VolumesSnapshotListTestJSON-205094583 None] Create snapshot completed successfully Sep 28 19:06:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] Creating offline snapshot 4e524690-21b0-4999-b2de-f63120d523fe of volume 9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:06:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c1812a-32ea-4861-8b8e-c8771b2b921b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:30 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b Sep 28 19:06:30 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:31 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b" returned: 0 in 0.542s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9acde06e-9846-487c-851c-2825b0eb0eec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:06:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:31 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe 1G Sep 28 19:06:31 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:31 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe 1G" returned: 0 in 0.633s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:31 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe Sep 28 19:06:31 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:32 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe" returned: 0 in 0.416s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:32 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe is being set with open permissions: ugo+rw Sep 28 19:06:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:32 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe Sep 28 19:06:32 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:32 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe" returned: 0 in 0.511s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:32 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:INSERT=24,cinder:SELECT=71,cinder:UPDATE=47,cinder:DELETE=5 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:06:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0fd67790-4f29-4a99-869c-c245f345e9ab tempest-VolumesSnapshotListTestJSON-205094583 None] Create snapshot completed successfully Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] Creating offline snapshot ed263c84-517f-4b60-8c04-fe71759e5d0b of volume 9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f274a04-eaa7-4a9b-8715-ba56c31aafa6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:34 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe Sep 28 19:06:34 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:34 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:06:34 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:34 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe" returned: 0 in 0.586s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9acde06e-9846-487c-851c-2825b0eb0eec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:06:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:34 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b 1G Sep 28 19:06:34 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:35 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Flow 'volume_create_manager' (f651c171-cf5e-48c9-9e45-4b85fea7a865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a88f9c-4918-4508-8083-771c32478e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a88f9c-4918-4508-8083-771c32478e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-627712186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c5757b-9db8-46d7-8055-0e2ad220a98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe63980e9df64b209524328249512fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:06:35Z,use_quota=True,user_id='99e122a128bd48aa90f4df1a4f2aaebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad69865-7ff9-44f9-b386-a05341389d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad69865-7ff9-44f9-b386-a05341389d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b758c0-00d6-4a09-a165-ced07b904ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b758c0-00d6-4a09-a165-ced07b904ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c5757b-9db8-46d7-8055-0e2ad220a98a', 'volume_name': 'volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3447ac-a6d7-4172-8a49-0ccabbe9feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3447ac-a6d7-4172-8a49-0ccabbe9feb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5ac464-bb6d-44bd-be80-8a3bb37f6360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Volume d8c5757b-9db8-46d7-8055-0e2ad220a98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a', 'volume_size': 1} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:35 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b 1G" returned: 0 in 0.795s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:35 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b Sep 28 19:06:35 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:35 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b" returned: 0 in 0.373s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:35 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b is being set with open permissions: ugo+rw Sep 28 19:06:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:36 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b Sep 28 19:06:36 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:36 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-627712186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c5757b-9db8-46d7-8055-0e2ad220a98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe63980e9df64b209524328249512fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:06:35Z,use_quota=True,user_id='99e122a128bd48aa90f4df1a4f2aaebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Creating volume d8c5757b-9db8-46d7-8055-0e2ad220a98a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:06:36 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:06:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:36 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a 1073741824 Sep 28 19:06:36 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b1f41c54-d66d-44dd-9dbd-a87aa9b14059 tempest-VolumesSnapshotListTestJSON-205094583 None] Create snapshot completed successfully Sep 28 19:06:37 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a 1073741824" returned: 0 in 0.599s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:37 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a Sep 28 19:06:37 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Flow 'volume_create_manager' (03e8a772-3265-4f66-b961-fc1c701a2162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1564d92-4729-4090-8069-2e5080f49b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1564d92-4729-4090-8069-2e5080f49b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1532723237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91540d9f-8d6b-4e8a-98b4-a13d1aef85d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdb69db7674a8a8a333996a3c1b6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:06:37Z,use_quota=True,user_id='96869ecf75864ac5a323efa249068afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a6b34e-9fcb-4f63-81ad-4944fbb53b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a6b34e-9fcb-4f63-81ad-4944fbb53b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d042a5da-8df6-4d3a-9217-1bbae75a0d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d042a5da-8df6-4d3a-9217-1bbae75a0d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91540d9f-8d6b-4e8a-98b4-a13d1aef85d6', 'volume_name': 'volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f49965-23ac-4a8e-8923-f379eb2fca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f49965-23ac-4a8e-8923-f379eb2fca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e61b09-a5f1-47cc-9553-e76c69a0d232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Volume 91540d9f-8d6b-4e8a-98b4-a13d1aef85d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6', 'volume_size': 1} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:37 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a" returned: 0 in 0.337s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.182s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1532723237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91540d9f-8d6b-4e8a-98b4-a13d1aef85d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdb69db7674a8a8a333996a3c1b6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:06:37Z,use_quota=True,user_id='96869ecf75864ac5a323efa249068afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Creating volume 91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:06:37 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5ac464-bb6d-44bd-be80-8a3bb37f6360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45137d7-ca0c-4a5a-8d21-6706d4cd9f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:37 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 1073741824 Sep 28 19:06:37 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Volume volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a (d8c5757b-9db8-46d7-8055-0e2ad220a98a): created successfully Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45137d7-ca0c-4a5a-8d21-6706d4cd9f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Flow 'volume_create_manager' (f651c171-cf5e-48c9-9e45-4b85fea7a865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:06:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-aa001dff-2f92-4037-901f-b14555b7b059 tempest-AbsoluteLimitsTests-522918898 None] Created volume successfully. Sep 28 19:06:38 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 1073741824" returned: 0 in 0.651s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:38 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 Sep 28 19:06:38 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:38 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e61b09-a5f1-47cc-9553-e76c69a0d232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2189241-fc57-4901-a3bf-70fd39a26b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Volume volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 (91540d9f-8d6b-4e8a-98b4-a13d1aef85d6): created successfully Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2189241-fc57-4901-a3bf-70fd39a26b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Flow 'volume_create_manager' (03e8a772-3265-4f66-b961-fc1c701a2162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:06:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-78714ed3-5191-481a-a428-24d52dd81127 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Created volume successfully. Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-ed263c84-517f-4b60-8c04-fe71759e5d0b-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-ed263c84-517f-4b60-8c04-fe71759e5d0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-quobyte-ed263c84-517f-4b60-8c04-fe71759e5d0b" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-ed263c84-517f-4b60-8c04-fe71759e5d0b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Deleting offline snapshot ed263c84-517f-4b60-8c04-fe71759e5d0b of volume 9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] snapshot_file for this snap is: volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Acquiring lock "cinder-d8c5757b-9db8-46d7-8055-0e2ad220a98a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Lock "cinder-d8c5757b-9db8-46d7-8055-0e2ad220a98a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb17f96e-583f-46fa-8a10-6c5a0a5b976c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Acquiring lock "cinder-quobyte-d8c5757b-9db8-46d7-8055-0e2ad220a98a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Lock "cinder-quobyte-d8c5757b-9db8-46d7-8055-0e2ad220a98a" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa86fd6b-8705-4fc8-bd5e-bdb4d4b45717]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:39 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b Sep 28 19:06:39 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:39 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a Sep 28 19:06:39 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Acquiring lock "cinder-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "cinder-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Acquiring lock "cinder-quobyte-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "cinder-quobyte-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1381175f-b61d-4049-b457-cafceccc181b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:39 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b" returned: 0 in 0.602s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9acde06e-9846-487c-851c-2825b0eb0eec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee38088-cc2e-4832-8d16-958052b88a63]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:39 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 Sep 28 19:06:39 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:39 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a" returned: 0 in 0.625s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:39 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a Sep 28 19:06:39 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:39 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe Sep 28 19:06:39 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:40 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6" returned: 0 in 0.525s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:40 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6 Sep 28 19:06:40 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:40 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe" returned: 0 in 0.517s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9acde06e-9846-487c-851c-2825b0eb0eec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:40 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b Sep 28 19:06:40 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:40 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8c5757b-9db8-46d7-8055-0e2ad220a98a" returned: 0 in 0.531s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Lock "cinder-quobyte-d8c5757b-9db8-46d7-8055-0e2ad220a98a" released by "delete_volume" :: held 1.239s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Created reservations ['519191fb-869e-47dc-869c-bdbcd80c65d6', 'aee4c666-1ef1-4d1d-93cb-71bd31644f63', '18d68f2d-aed1-45fb-b307-f9dbdafe554f', 'd42ecd19-9f3f-4085-b440-78d66b6725ed'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:40 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6" returned: 0 in 0.382s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "cinder-quobyte-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6" released by "delete_volume" :: held 0.986s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:40 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:06:40 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Created reservations ['446f9b6d-f18a-4ee7-8e9a-1b98e89a8cee', '1ca5c861-4de7-46fd-906e-ad9958f7d4db', 'aee5476c-a62f-49bc-91d2-a9fce690d8e1', '438afd5a-bd6a-4948-ba9e-f6fa57585160'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:40 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:06:40 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:40 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b" returned: 0 in 0.711s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:40 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b Sep 28 19:06:40 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:40 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.380s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:40 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:06:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Deleted volume successfully. Sep 28 19:06:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d29c5bba-77fe-4975-afb0-bb6c1bc9b24b tempest-AbsoluteLimitsTests-522918898 None] Lock "cinder-d8c5757b-9db8-46d7-8055-0e2ad220a98a-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:41 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.451s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:41 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:06:41 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.ed263c84-517f-4b60-8c04-fe71759e5d0b" returned: 0 in 0.371s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Deleted volume successfully. Sep 28 19:06:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-ed263c84-517f-4b60-8c04-fe71759e5d0b" released by "_delete_snapshot" :: held 2.402s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" released by "delete_snapshot" :: held 2.454s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e43240f7-082d-428d-b8a6-e36f01d1d510 tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "cinder-91540d9f-8d6b-4e8a-98b4-a13d1aef85d6-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:41 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Created reservations ['62eb39f7-7801-43ed-846e-2226d9074d2f', '2449c2ce-5c71-49ec-8c88-bc7c5bea4297', 'c18a6a10-722c-43d1-b355-50d5f3315ac7', '4f388816-0878-4713-ba0b-cb52e5e7fdc1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Delete snapshot completed successfully. Sep 28 19:06:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5649716-0b19-467d-87b8-c5bf288faf4a tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-ed263c84-517f-4b60-8c04-fe71759e5d0b-delete_snapshot" released by "delete_snapshot" :: held 2.654s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-4e524690-21b0-4999-b2de-f63120d523fe-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-4e524690-21b0-4999-b2de-f63120d523fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-quobyte-4e524690-21b0-4999-b2de-f63120d523fe" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-4e524690-21b0-4999-b2de-f63120d523fe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Deleting offline snapshot 4e524690-21b0-4999-b2de-f63120d523fe of volume 9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] snapshot_file for this snap is: volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c8ed29-4786-4edb-a33a-7312de7a758a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:42 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe Sep 28 19:06:42 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Flow 'volume_create_manager' (3d69bc6e-5c00-42a7-91c4-9125f7b97460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d30710-f733-4245-8025-54e880f9042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d30710-f733-4245-8025-54e880f9042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1247639822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa87561-c083-4d15-b15b-d1451eaa600e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdb69db7674a8a8a333996a3c1b6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:06:43Z,use_quota=True,user_id='96869ecf75864ac5a323efa249068afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281b9f82-6a8f-4649-8b1b-4a90b3c42242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281b9f82-6a8f-4649-8b1b-4a90b3c42242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ff0154-c038-4757-bf77-274f199dec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ff0154-c038-4757-bf77-274f199dec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa87561-c083-4d15-b15b-d1451eaa600e', 'volume_name': 'volume-1fa87561-c083-4d15-b15b-d1451eaa600e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf9cc41-87cf-47a1-9c32-b1dcd993c666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf9cc41-87cf-47a1-9c32-b1dcd993c666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe47e11-5c34-4673-a491-8f3b374fac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Volume 1fa87561-c083-4d15-b15b-d1451eaa600e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa87561-c083-4d15-b15b-d1451eaa600e', 'volume_size': 1} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1247639822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa87561-c083-4d15-b15b-d1451eaa600e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbdb69db7674a8a8a333996a3c1b6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:06:43Z,use_quota=True,user_id='96869ecf75864ac5a323efa249068afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Creating volume 1fa87561-c083-4d15-b15b-d1451eaa600e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:42 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:06:42 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe" returned: 0 in 0.549s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9acde06e-9846-487c-851c-2825b0eb0eec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:06:42 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e 1073741824 Sep 28 19:06:42 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ccb4c2-26a4-4ed3-9006-dc2ecec3e9d6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:42 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b Sep 28 19:06:42 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:43 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e 1073741824" returned: 0 in 0.581s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:43 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b" returned: 0 in 0.520s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9acde06e-9846-487c-851c-2825b0eb0eec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:43 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe Sep 28 19:06:43 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:43 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e Sep 28 19:06:43 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:43 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e" returned: 0 in 0.390s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe47e11-5c34-4673-a491-8f3b374fac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa87561-c083-4d15-b15b-d1451eaa600e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3e3d38-f4d7-40f6-9c54-f968451d3283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Volume volume-1fa87561-c083-4d15-b15b-d1451eaa600e (1fa87561-c083-4d15-b15b-d1451eaa600e): created successfully Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3e3d38-f4d7-40f6-9c54-f968451d3283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Flow 'volume_create_manager' (3d69bc6e-5c00-42a7-91c4-9125f7b97460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:06:43 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe" returned: 0 in 0.523s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5a636abb-87df-4c2c-8ff6-6d82dde492ca tempest-VolumeQuotasAdminTestJSON-1106017793 None] Created volume successfully. Sep 28 19:06:43 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe Sep 28 19:06:43 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:44 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.4e524690-21b0-4999-b2de-f63120d523fe" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-4e524690-21b0-4999-b2de-f63120d523fe" released by "_delete_snapshot" :: held 2.076s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" released by "delete_snapshot" :: held 2.112s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:44 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Created reservations ['89ac5f63-78b9-47a7-b7de-f93c923ff1d4', '482c8c89-743f-4717-9792-deeca29c486f', '1ace87b4-0007-414b-bfd3-beacaa4a891b', '20fa3e8b-a478-4473-8228-88ceb2efe80e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Delete snapshot completed successfully. Sep 28 19:06:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4025963-285f-4225-835d-c8a7f78889b5 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-4e524690-21b0-4999-b2de-f63120d523fe-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-2b15d959-1c1d-4a24-bf85-1a594531b45b-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-2b15d959-1c1d-4a24-bf85-1a594531b45b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-quobyte-2b15d959-1c1d-4a24-bf85-1a594531b45b" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-2b15d959-1c1d-4a24-bf85-1a594531b45b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Deleting offline snapshot 2b15d959-1c1d-4a24-bf85-1a594531b45b of volume 9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] snapshot_file for this snap is: volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe87c79-209f-46ca-bf51-e48c3ea953d9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:45 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b Sep 28 19:06:45 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fa7c022a-e742-4e5f-b907-dac33258e837 tempest-VolumeQuotasAdminTestJSON-229773544 None] Transfer volume completed successfully. Sep 28 19:06:45 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b" returned: 0 in 0.509s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9acde06e-9846-487c-851c-2825b0eb0eec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:06:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[977019ef-4f20-4be0-9ad9-1cc4170dfdf2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:46 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec Sep 28 19:06:46 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Acquiring lock "cinder-1fa87561-c083-4d15-b15b-d1451eaa600e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Lock "cinder-1fa87561-c083-4d15-b15b-d1451eaa600e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Acquiring lock "cinder-quobyte-1fa87561-c083-4d15-b15b-d1451eaa600e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Lock "cinder-quobyte-1fa87561-c083-4d15-b15b-d1451eaa600e" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:46 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec" returned: 0 in 0.519s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7636faf-1aa9-4df7-b5b8-accdd1d178bc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:46 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b Sep 28 19:06:46 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:46 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e Sep 28 19:06:46 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:47 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:47 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b" returned: 0 in 0.484s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:47 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e Sep 28 19:06:47 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:47 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b Sep 28 19:06:47 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:47 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec.2b15d959-1c1d-4a24-bf85-1a594531b45b" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:47 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fa87561-c083-4d15-b15b-d1451eaa600e" returned: 0 in 0.365s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-2b15d959-1c1d-4a24-bf85-1a594531b45b" released by "_delete_snapshot" :: held 2.020s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Lock "cinder-quobyte-1fa87561-c083-4d15-b15b-d1451eaa600e" released by "delete_volume" :: held 0.906s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" released by "delete_snapshot" :: held 2.058s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Created reservations ['26a0b163-3fa3-425f-9552-8ac85fbd7366', 'df9d0e3d-6f53-4e7e-8b18-43bb06d80c04', '9f1e66d6-293f-4ea7-aaef-21671769fbb1', '8b195853-4d32-4d72-b519-c21f6ac9da33'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Created reservations ['c4e20bc0-7244-41d7-b00b-32cb5fb2d2f0', '0117a355-e745-4cf1-8bfb-74096093d9ab', '483fa6ee-b82a-47c6-b251-fff77dc81c31', 'a3a6efb0-85eb-4514-80e4-aa36d9be89d5'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Delete snapshot completed successfully. Sep 28 19:06:47 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:06:47 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98cc592c-0979-498e-855e-6a6d85d40442 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-2b15d959-1c1d-4a24-bf85-1a594531b45b-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Flow 'volume_create_manager' (7e7d326e-9b42-405c-8815-60eae5b9fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:06:47 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaffb0be-ae59-43a7-9f2f-1ec6aa750d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:06:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Deleted volume successfully. Sep 28 19:06:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaffb0be-ae59-43a7-9f2f-1ec6aa750d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1240058556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbf8bdf-9130-47dd-974c-d43e0576f5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4041ab46217841428be5d02242afbdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:06:48Z,use_quota=True,user_id='88d0eb54933a46f684ea0311605862fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd2f784-dc1f-4fcf-9198-3de571140563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd2f784-dc1f-4fcf-9198-3de571140563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf791177-a075-4664-a285-4c13ce3e1671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf791177-a075-4664-a285-4c13ce3e1671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fbf8bdf-9130-47dd-974c-d43e0576f5e8', 'volume_name': 'volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e785ac68-e770-4453-8073-6daf9e3d71e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e785ac68-e770-4453-8073-6daf9e3d71e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17eb856-54b7-4d15-bae6-c1b985f837fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Volume 6fbf8bdf-9130-47dd-974c-d43e0576f5e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8', 'volume_size': 1} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1240058556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbf8bdf-9130-47dd-974c-d43e0576f5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4041ab46217841428be5d02242afbdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:06:48Z,use_quota=True,user_id='88d0eb54933a46f684ea0311605862fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Creating volume 6fbf8bdf-9130-47dd-974c-d43e0576f5e8 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:06:48 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79640bc7-f634-4487-af8b-fc41538a634a tempest-VolumeQuotasAdminTestJSON-1238390679 None] Lock "cinder-1fa87561-c083-4d15-b15b-d1451eaa600e-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:48 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 1073741824 Sep 28 19:06:48 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:48 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 1073741824" returned: 0 in 0.530s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-9acde06e-9846-487c-851c-2825b0eb0eec-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-9acde06e-9846-487c-851c-2825b0eb0eec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:48 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 Sep 28 19:06:48 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd30b7cf-08e4-4062-8a9e-5b6d32cc5b7d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:49 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17eb856-54b7-4d15-bae6-c1b985f837fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:49 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec Sep 28 19:06:49 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d5227e-66aa-4056-9681-59a5dccbff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:06:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Volume volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 (6fbf8bdf-9130-47dd-974c-d43e0576f5e8): created successfully Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d5227e-66aa-4056-9681-59a5dccbff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Flow 'volume_create_manager' (7e7d326e-9b42-405c-8815-60eae5b9fa63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:06:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b8ec7b55-d87a-4545-95a2-73932441f3ef tempest-VolumesDeleteCascade-990295606 None] Created volume successfully. Sep 28 19:06:49 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec" returned: 0 in 0.487s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:49 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec Sep 28 19:06:49 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:49 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9acde06e-9846-487c-851c-2825b0eb0eec" returned: 0 in 0.310s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-quobyte-9acde06e-9846-487c-851c-2825b0eb0eec" released by "delete_volume" :: held 0.956s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:49 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Created reservations ['4ffb9a67-9fb2-4e51-8a45-3840b0fb007b', '689dcf21-3d69-4d48-83b4-15bcd4cb77e5', 'b62a59d0-badb-466b-992d-acc0ba9c1fdb', '4fe75b5b-1a17-49ec-9fe0-61579c70eeae'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:50 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:06:50 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Creating offline snapshot 49feeba7-5494-4624-8162-ad2d55ac039d of volume 6fbf8bdf-9130-47dd-974c-d43e0576f5e8 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53d9e7e-cc58-4a1d-9474-a39346d848ac]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:50 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.472s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:06:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Deleted volume successfully. Sep 28 19:06:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fb5bbfdc-aff4-4f63-adcd-3a2676f5ac31 tempest-VolumesSnapshotListTestJSON-205094583 None] Lock "cinder-9acde06e-9846-487c-851c-2825b0eb0eec-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:50 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 Sep 28 19:06:50 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:51 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" returned: 0 in 0.516s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:51 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d 1G Sep 28 19:06:51 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:51 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d 1G" returned: 0 in 0.761s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:51 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d Sep 28 19:06:51 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:52 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d" returned: 0 in 0.427s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:52 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d is being set with open permissions: ugo+rw Sep 28 19:06:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:52 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d Sep 28 19:06:52 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:52 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d" returned: 0 in 0.364s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:52 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.info Sep 28 19:06:52 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:53 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.info" returned: 0 in 0.390s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:53 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.info is being set with open permissions: ugo+rw Sep 28 19:06:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:53 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.info Sep 28 19:06:53 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:53 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.info" returned: 0 in 0.423s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.053s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0c1127f2-de37-4c36-9352-eea0ee7ea89a tempest-VolumesDeleteCascade-990295606 None] Create snapshot completed successfully Sep 28 19:06:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] Creating offline snapshot 383f34ac-9e61-4e03-b762-cf8cac20a6b5 of volume 6fbf8bdf-9130-47dd-974c-d43e0576f5e8 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:06:54 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fe1993-692c-4265-9b56-87452cb5b3f9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:54 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d Sep 28 19:06:54 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:55 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d" returned: 0 in 0.679s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:06:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:55 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 1G Sep 28 19:06:55 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:55 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 1G" returned: 0 in 0.863s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:55 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 Sep 28 19:06:55 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-51074766-e36a-4fdb-9800-06396cee0873 tempest-ServerActionsTestOtherA-1124315465 None] Terminate volume connection completed successfully. Sep 28 19:06:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-51074766-e36a-4fdb-9800-06396cee0873 tempest-ServerActionsTestOtherA-1124315465 None] Deleting attachment 6e2a8820-8613-463c-bb2e-d6029d0d62f4. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:06:56 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5" returned: 0 in 0.538s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:56 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 is being set with open permissions: ugo+rw Sep 28 19:06:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:56 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 Sep 28 19:06:56 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "cinder-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Lock "cinder-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "cinder-quobyte-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Lock "cinder-quobyte-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4469e723-ac98-4be5-9f66-a7bcfef36217]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:56 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 Sep 28 19:06:56 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:57 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5" returned: 0 in 0.564s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.857s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d2245ac8-896c-44cb-8a1a-7990cba2f493 tempest-VolumesDeleteCascade-990295606 None] Create snapshot completed successfully Sep 28 19:06:57 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20" returned: 0 in 0.801s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:57 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20 Sep 28 19:06:57 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-6fbf8bdf-9130-47dd-974c-d43e0576f5e8-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-6fbf8bdf-9130-47dd-974c-d43e0576f5e8-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "cinder-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Performing cascade delete. {{(pid=86846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Lock "cinder-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-383f34ac-9e61-4e03-b762-cf8cac20a6b5-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:57 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-383f34ac-9e61-4e03-b762-cf8cac20a6b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Lock "cinder-quobyte-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20" released by "delete_volume" :: held 1.245s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "cinder-quobyte-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-383f34ac-9e61-4e03-b762-cf8cac20a6b5" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:06:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Lock "cinder-quobyte-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03" acquired by "delete_volume" :: waited 0.052s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-383f34ac-9e61-4e03-b762-cf8cac20a6b5" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Deleting offline snapshot 383f34ac-9e61-4e03-b762-cf8cac20a6b5 of volume 6fbf8bdf-9130-47dd-974c-d43e0576f5e8 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] snapshot_file for this snap is: volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fca9898-4e7f-4fe4-aac7-807d850f2f09]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef0036a-cda7-4da0-b1ed-d77671961492]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG cinder.quota [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Created reservations ['223233ba-1578-4d4e-ad83-6a7bae810284', 'e0561893-7f1f-4cc9-a977-c75c2a587973', 'f974f3ca-7f1f-4c17-8baa-8dbb95735ae1', '7280ec9e-5f16-4843-83cd-1d633cb567a5'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:58 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 Sep 28 19:06:58 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:58 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:06:58 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:58 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 Sep 28 19:06:58 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:58 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:58 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03 Sep 28 19:06:58 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:58 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG cinder.manager [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:06:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Deleted volume successfully. Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-74093e50-973e-4dc7-b25a-979a4002dbaf req-651172dd-9ff0-4485-8955-901d49533053 tempest-ServerActionsTestOtherA-1124315465 None] Lock "cinder-3a5ab6bc-e2e6-4fac-bba6-3db9cd55ea20-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:58 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5" returned: 0 in 0.720s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2fd7f9-f329-4089-8c88-ee0b345b7605]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:06:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:59 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:59 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d Sep 28 19:06:59 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03" returned: 0 in 0.534s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Lock "cinder-quobyte-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03" released by "delete_volume" :: held 1.171s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Created reservations ['c45015a0-836d-43fe-9657-4a5246eeb7e2', '4b547942-05b4-42ae-9892-b0a0a1894459', '158cb155-1f53-4856-9fa9-596909d79b99', '2c424d63-685d-46e2-bc06-c7bd17fbf431'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:59 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:06:59 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:59 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:06:59 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 Sep 28 19:06:59 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:06:59 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:06:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Deleted volume successfully. Sep 28 19:06:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc2ffd0a-fae6-4923-8ecd-b2a03d785045 tempest-ServerActionsTestOtherA-1124315465 None] Lock "cinder-d1686e9a-8ae4-47bf-86a7-fc5af15fbf03-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:00 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5" returned: 0 in 0.599s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:00 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5 Sep 28 19:07:00 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:00 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.383f34ac-9e61-4e03-b762-cf8cac20a6b5" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-383f34ac-9e61-4e03-b762-cf8cac20a6b5" released by "_delete_snapshot" :: held 2.600s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" released by "delete_snapshot" :: held 2.669s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:00 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Created reservations ['c2ecf50a-0a9c-4eb7-9d6d-7139b013442c', 'b31d843d-9440-4021-8fc1-7b87be08638a', 'fce416ce-d4e5-4214-afe6-05db28a1b67c', 'a19221ed-51d0-4492-b040-30cace7e78aa'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:07:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Delete snapshot completed successfully. Sep 28 19:07:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-383f34ac-9e61-4e03-b762-cf8cac20a6b5-delete_snapshot" released by "delete_snapshot" :: held 3.060s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-49feeba7-5494-4624-8162-ad2d55ac039d-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-49feeba7-5494-4624-8162-ad2d55ac039d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-49feeba7-5494-4624-8162-ad2d55ac039d" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-49feeba7-5494-4624-8162-ad2d55ac039d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Deleting offline snapshot 49feeba7-5494-4624-8162-ad2d55ac039d of volume 6fbf8bdf-9130-47dd-974c-d43e0576f5e8 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:07:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] snapshot_file for this snap is: volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:07:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfba5c53-7fd5-43f9-83d1-6ad3f146ae96]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:01 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d Sep 28 19:07:01 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:01 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d" returned: 0 in 0.779s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:07:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[065eb9b6-c8ab-4161-98dd-2909af0d2401]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:02 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 Sep 28 19:07:02 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:02 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" returned: 0 in 0.502s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:02 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d Sep 28 19:07:02 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:03 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d" returned: 0 in 0.559s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:03 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d Sep 28 19:07:03 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:03 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8.49feeba7-5494-4624-8162-ad2d55ac039d" returned: 0 in 0.455s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-49feeba7-5494-4624-8162-ad2d55ac039d" released by "_delete_snapshot" :: held 2.567s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" released by "delete_snapshot" :: held 2.605s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Created reservations ['c684f034-2f4e-49a5-abc2-03123bb6f925', '8f5f9316-6e39-43f9-b4c5-dbd433e657fd', '91382864-6654-4cfb-a1f6-a7b6934921d7', '7c4d9137-c0c2-4702-8aa7-6af005fde3c4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:07:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Delete snapshot completed successfully. Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-49feeba7-5494-4624-8162-ad2d55ac039d-delete_snapshot" released by "delete_snapshot" :: held 2.881s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Snapshots deleted, issuing volume delete {{(pid=86846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" acquired by "delete_volume" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f7ca4d-d04b-4acd-a97a-e04ae1ec8fcc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:04 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 Sep 28 19:07:04 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:04 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" returned: 0 in 0.632s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:04 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8 Sep 28 19:07:04 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:04 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" returned: 0 in 0.351s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-6fbf8bdf-9130-47dd-974c-d43e0576f5e8" released by "delete_volume" :: held 1.132s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Created reservations ['797bba71-4b8f-4a57-aaad-2fb88136570a', '416caef0-3cab-4693-ba4f-4eeb7b05bb36', '7cad82bb-e070-4a19-b5d9-9bdd8785571f', '333cfda6-a648-44cd-889e-8fd95ba909ee'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:05 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:07:05 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:05 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.375s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:07:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Deleted volume successfully. Sep 28 19:07:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6ffabf1-3ee9-428f-bae5-72bcef6060cc tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-6fbf8bdf-9130-47dd-974c-d43e0576f5e8-delete_volume" released by "delete_volume" :: held 8.009s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Flow 'volume_create_manager' (f8e76738-5f3e-40f9-a318-69e15c5a13d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ab0c57-82c5-4127-b354-7f296d4ca586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ab0c57-82c5-4127-b354-7f296d4ca586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1764205838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f8782e-baa1-45d9-8a67-9dab92c1293a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4041ab46217841428be5d02242afbdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:07:07Z,use_quota=True,user_id='88d0eb54933a46f684ea0311605862fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6894e83a-37e0-4a61-9c46-ddbb10f40de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6894e83a-37e0-4a61-9c46-ddbb10f40de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8f6756-b366-4e68-a1e0-a500741ebc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8f6756-b366-4e68-a1e0-a500741ebc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f8782e-baa1-45d9-8a67-9dab92c1293a', 'volume_name': 'volume-01f8782e-baa1-45d9-8a67-9dab92c1293a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815a8691-5512-4f1a-8285-b0cd5a5f805f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815a8691-5512-4f1a-8285-b0cd5a5f805f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d23cfc-b6bc-4357-803c-bb5a18f21053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Volume 01f8782e-baa1-45d9-8a67-9dab92c1293a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f8782e-baa1-45d9-8a67-9dab92c1293a', 'volume_size': 1} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1764205838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f8782e-baa1-45d9-8a67-9dab92c1293a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4041ab46217841428be5d02242afbdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:07:07Z,use_quota=True,user_id='88d0eb54933a46f684ea0311605862fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Creating volume 01f8782e-baa1-45d9-8a67-9dab92c1293a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:07:07 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:07:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:07 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a 1073741824 Sep 28 19:07:07 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:08 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a 1073741824" returned: 0 in 0.689s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:08 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a Sep 28 19:07:08 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:08 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:07:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d23cfc-b6bc-4357-803c-bb5a18f21053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f8782e-baa1-45d9-8a67-9dab92c1293a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be04a2b-cc25-404a-815a-19dfb2de69e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Volume volume-01f8782e-baa1-45d9-8a67-9dab92c1293a (01f8782e-baa1-45d9-8a67-9dab92c1293a): created successfully Sep 28 19:07:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be04a2b-cc25-404a-815a-19dfb2de69e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Flow 'volume_create_manager' (f8e76738-5f3e-40f9-a318-69e15c5a13d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:07:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-46c0ecee-2c77-4626-8de0-f088a8be2be5 tempest-VolumesDeleteCascade-990295606 None] Created volume successfully. Sep 28 19:07:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Creating offline snapshot 09df5364-7800-4cdf-b6bf-98ad7d0b8108 of volume 01f8782e-baa1-45d9-8a67-9dab92c1293a {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:07:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e4a0f6-62db-482e-a734-ccdb8c93fa37]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:10 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a Sep 28 19:07:10 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:10 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a" returned: 0 in 0.945s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:10 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 1G Sep 28 19:07:10 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:11 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 1G" returned: 0 in 0.820s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f8782e-baa1-45d9-8a67-9dab92c1293a -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:11 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f8782e-baa1-45d9-8a67-9dab92c1293a -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 Sep 28 19:07:11 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:12 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f8782e-baa1-45d9-8a67-9dab92c1293a -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108" returned: 0 in 0.463s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:12 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 is being set with open permissions: ugo+rw Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:12 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 Sep 28 19:07:12 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:12 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108" returned: 0 in 0.407s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:12 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.info Sep 28 19:07:12 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Flow 'volume_create_manager' (02b15d04-1c70-43ba-a8db-cbf6c3fab50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fde9e3-7a3b-405d-bb9b-bff75afe03bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fde9e3-7a3b-405d-bb9b-bff75afe03bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-375911546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69bc861a-3e66-4e65-8b39-8492c32a5cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f24db73a42db44d0a18deb2d57f05ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:07:13Z,use_quota=True,user_id='4ab5310c0cc24f52a8daed2f22cf10ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(767667a1-113f-4908-bfa8-ac4fc741946d),volume_type_id=767667a1-113f-4908-bfa8-ac4fc741946d)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3309eb78-5955-4692-a94b-04e61d2ce358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3309eb78-5955-4692-a94b-04e61d2ce358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640be4ed-a27e-42f2-b31e-8f2acf4af2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640be4ed-a27e-42f2-b31e-8f2acf4af2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69bc861a-3e66-4e65-8b39-8492c32a5cb2', 'volume_name': 'volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3563a551-cdff-4ba0-9e80-b3c426c20a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3563a551-cdff-4ba0-9e80-b3c426c20a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6aaefc0-e6d6-4f69-9f77-2ad07c78c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Volume 69bc861a-3e66-4e65-8b39-8492c32a5cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2', 'volume_size': 1} Sep 28 19:07:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:13 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.info" returned: 0 in 0.442s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:13 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.info is being set with open permissions: ugo+rw Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:13 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.info Sep 28 19:07:13 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:13 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.info" returned: 0 in 0.394s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.667s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-375911546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69bc861a-3e66-4e65-8b39-8492c32a5cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f24db73a42db44d0a18deb2d57f05ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:07:13Z,use_quota=True,user_id='4ab5310c0cc24f52a8daed2f22cf10ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(767667a1-113f-4908-bfa8-ac4fc741946d),volume_type_id=767667a1-113f-4908-bfa8-ac4fc741946d)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Creating volume 69bc861a-3e66-4e65-8b39-8492c32a5cb2 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:07:13 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:07:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:13 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2 1073741824 Sep 28 19:07:13 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-def7f47f-5188-4879-834d-eba773553b4c tempest-VolumesDeleteCascade-990295606 None] Create snapshot completed successfully Sep 28 19:07:14 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2 1073741824" returned: 0 in 0.722s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:14 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2 Sep 28 19:07:14 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:14 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2" returned: 0 in 0.548s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:07:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6aaefc0-e6d6-4f69-9f77-2ad07c78c29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fcb194-7162-4d24-a4c7-7ea96b72899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Volume volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2 (69bc861a-3e66-4e65-8b39-8492c32a5cb2): created successfully Sep 28 19:07:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fcb194-7162-4d24-a4c7-7ea96b72899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Flow 'volume_create_manager' (02b15d04-1c70-43ba-a8db-cbf6c3fab50b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:07:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4f816253-8cdc-4e07-b2ce-0f803943d863 tempest-VolumeTypesAccessTest-987353297 None] Created volume successfully. Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Flow 'volume_create_manager' (d4c42a1b-fbfa-4007-829d-d2ba2ade05ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46af477d-cbf5-4513-bc61-436d750dfabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46af477d-cbf5-4513-bc61-436d750dfabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2002705335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4041ab46217841428be5d02242afbdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=09df5364-7800-4cdf-b6bf-98ad7d0b8108,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:07:15Z,use_quota=True,user_id='88d0eb54933a46f684ea0311605862fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a1b815-c933-40bc-b51b-ed205d3bfa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a1b815-c933-40bc-b51b-ed205d3bfa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57121976-33a6-4a92-932b-a673248d8a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57121976-33a6-4a92-932b-a673248d8a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac', 'volume_name': 'volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac', 'volume_size': 1, 'snapshot_id': '09df5364-7800-4cdf-b6bf-98ad7d0b8108'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9364b31d-45bb-40b8-886e-4255928ec734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9364b31d-45bb-40b8-886e-4255928ec734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380e68d9-0b9f-4527-8c5a-803ed6f477b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Volume 4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac', 'volume_size': 1, 'snapshot_id': '09df5364-7800-4cdf-b6bf-98ad7d0b8108'} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-09df5364-7800-4cdf-b6bf-98ad7d0b8108-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-09df5364-7800-4cdf-b6bf-98ad7d0b8108-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Creating volume 4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac from snapshot 09df5364-7800-4cdf-b6bf-98ad7d0b8108 {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] snapshot: 09df5364-7800-4cdf-b6bf-98ad7d0b8108, volume: 4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2073c5d-4415-4555-a88e-a016bdb7aa8f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:15 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 Sep 28 19:07:15 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:15 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108" returned: 0 in 0.552s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01f8782e-baa1-45d9-8a67-9dab92c1293a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0bbe8c-4c31-4927-a8fd-33784ee2d0e5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:16 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a Sep 28 19:07:16 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Acquiring lock "cinder-69bc861a-3e66-4e65-8b39-8492c32a5cb2-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Lock "cinder-69bc861a-3e66-4e65-8b39-8492c32a5cb2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=114,cinder:UPDATE=106,cinder:INSERT=27,cinder:DELETE=11 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Acquiring lock "cinder-quobyte-69bc861a-3e66-4e65-8b39-8492c32a5cb2" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Lock "cinder-quobyte-69bc861a-3e66-4e65-8b39-8492c32a5cb2" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5903f7-7294-4980-8ba3-b38e1024ffba]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:16 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a" returned: 0 in 0.746s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:07:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:16 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac Sep 28 19:07:16 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:16 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2 Sep 28 19:07:16 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:17 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2" returned: 0 in 0.535s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:17 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2 Sep 28 19:07:17 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:17 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-69bc861a-3e66-4e65-8b39-8492c32a5cb2" returned: 0 in 0.467s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Lock "cinder-quobyte-69bc861a-3e66-4e65-8b39-8492c32a5cb2" released by "delete_volume" :: held 1.103s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:17 devstack cinder-volume[86846]: WARNING cinder.quota [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-775835119 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-775835119, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:07:17 devstack cinder-volume[86846]: WARNING cinder.quota [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-775835119 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-775835119, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Created reservations ['06342e85-d374-499d-a470-586f9dbefc90', 'f50c179f-510b-473c-ad8d-a8595d6d3911', '94219d8b-e281-4813-a9df-bb16a32cff27', 'a8bb0e51-66f0-4660-8191-463ebfd2e3ca'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:18 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:07:18 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:18 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 1.007s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:18 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:07:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Deleted volume successfully. Sep 28 19:07:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7f3e99f-eebd-428b-af5d-796f9ee927ca tempest-VolumeTypesAccessTest-987353297 None] Lock "cinder-69bc861a-3e66-4e65-8b39-8492c32a5cb2-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:26 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" returned: 0 in 9.887s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:26 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a, size 1024.00 MB, duration 9.89 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:07:26 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Converted 1024.00 MB image at 103.56 MB/s Sep 28 19:07:26 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac is being set with open permissions: ugo+rw Sep 28 19:07:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:26 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac Sep 28 19:07:26 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:26 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" released by "_copy_volume_from_snapshot" :: held 11.675s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-09df5364-7800-4cdf-b6bf-98ad7d0b8108-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" released by "_create_volume_from_snapshot" :: held 11.767s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.793s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380e68d9-0b9f-4527-8c5a-803ed6f477b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac', 'volume_size': 1, 'snapshot_id': '09df5364-7800-4cdf-b6bf-98ad7d0b8108'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef53489-0bd9-4e25-add6-5c4237e7fdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Volume volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac (4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac): created successfully Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef53489-0bd9-4e25-add6-5c4237e7fdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Flow 'volume_create_manager' (d4c42a1b-fbfa-4007-829d-d2ba2ade05ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:07:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-20bd0fc4-37ff-40b4-8097-a758eba34af1 tempest-VolumesDeleteCascade-990295606 None] Created volume successfully. Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-01f8782e-baa1-45d9-8a67-9dab92c1293a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-01f8782e-baa1-45d9-8a67-9dab92c1293a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Performing cascade delete. {{(pid=86846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-09df5364-7800-4cdf-b6bf-98ad7d0b8108-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-09df5364-7800-4cdf-b6bf-98ad7d0b8108-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-01f8782e-baa1-45d9-8a67-9dab92c1293a" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-01f8782e-baa1-45d9-8a67-9dab92c1293a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-09df5364-7800-4cdf-b6bf-98ad7d0b8108" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-09df5364-7800-4cdf-b6bf-98ad7d0b8108" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Deleting offline snapshot 09df5364-7800-4cdf-b6bf-98ad7d0b8108 of volume 01f8782e-baa1-45d9-8a67-9dab92c1293a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] snapshot_file for this snap is: volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b76d21-0180-4c89-bc79-7870e782f6e8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:28 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 Sep 28 19:07:28 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:28 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108" returned: 0 in 0.472s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01f8782e-baa1-45d9-8a67-9dab92c1293a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:07:28 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[36620302-0a82-4607-b985-30ea093b63f0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:28 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a Sep 28 19:07:28 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:29 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a" returned: 0 in 0.676s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:29 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 Sep 28 19:07:29 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:29 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108" returned: 0 in 0.496s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:29 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108 Sep 28 19:07:29 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:29 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a.09df5364-7800-4cdf-b6bf-98ad7d0b8108" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-09df5364-7800-4cdf-b6bf-98ad7d0b8108" released by "_delete_snapshot" :: held 2.208s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-01f8782e-baa1-45d9-8a67-9dab92c1293a" released by "delete_snapshot" :: held 2.249s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Created reservations ['df79921a-5b87-42d4-b4e2-19a9f3bebc36', '01044ac9-a1f5-43a5-bc8b-085c0a1215d8', '2f2847f9-1990-47a2-855b-c7ddacd4e2cb', 'fc88041d-fdd7-4ed1-b3f3-716b220d897a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:07:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Delete snapshot completed successfully. Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-09df5364-7800-4cdf-b6bf-98ad7d0b8108-delete_snapshot" released by "delete_snapshot" :: held 2.481s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Snapshots deleted, issuing volume delete {{(pid=86846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-01f8782e-baa1-45d9-8a67-9dab92c1293a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-01f8782e-baa1-45d9-8a67-9dab92c1293a" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e207a7-c5cd-42ab-892f-b3a04afc9717]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:30 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a Sep 28 19:07:30 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:30 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a" returned: 0 in 0.506s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:30 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a Sep 28 19:07:30 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:31 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-01f8782e-baa1-45d9-8a67-9dab92c1293a" returned: 0 in 0.388s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-01f8782e-baa1-45d9-8a67-9dab92c1293a" released by "delete_volume" :: held 1.002s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Created reservations ['9f377cdf-b707-47b4-b661-a2bff9cbda1b', '678d987d-c478-4624-986a-d8cd4d01842f', '13b04129-cfe3-4ae2-adbf-00c553130106', '6c78052b-8bc2-46c2-8be5-c99f8660841f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:31 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:07:31 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:31 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:07:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Deleted volume successfully. Sep 28 19:07:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ec4f204-0e19-4014-9934-e56c036d0f42 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-01f8782e-baa1-45d9-8a67-9dab92c1293a-delete_volume" released by "delete_volume" :: held 4.118s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "cinder-quobyte-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9c1ae1-8b37-4276-9923-bd7d31d226ac]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:32 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac Sep 28 19:07:32 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:33 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" returned: 0 in 0.490s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:33 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac Sep 28 19:07:33 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:33 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" returned: 0 in 0.313s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-quobyte-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac" released by "delete_volume" :: held 0.871s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:DELETE=9,cinder:SELECT=101,cinder:UPDATE=135,cinder:INSERT=36 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Created reservations ['79f1c723-2f49-4357-ae39-f028fed84561', '14df3c7b-d382-4cf0-a0f0-76c1ff565bba', 'b3c8b818-17c4-44b5-b797-8668eed40de0', '008ee6a4-d78a-4d0a-a7d2-758aacfb87f1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:33 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:07:33 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:33 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.383s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:33 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:07:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Deleted volume successfully. Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a570ec80-ba67-46f3-a29a-6d5a2f3f4841 tempest-VolumesDeleteCascade-990295606 None] Lock "cinder-4fe6a2b6-8e31-4ed9-8876-4f38eb2598ac-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:34 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:07:34 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:34 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:07:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:07:43 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:INSERT=1,cinder:UPDATE=7,cinder:SELECT=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:07:43 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=22,cinder:INSERT=10,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Flow 'volume_create_manager' (032c5129-46c4-449d-bc61-4a43715514cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0319147b-a972-4559-9a4f-79c854974da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0319147b-a972-4559-9a4f-79c854974da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1254788552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305afffe-ae58-4583-b8d9-5d3db9028779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61056a4711974d56ad0a48b334c58475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:07:45Z,use_quota=True,user_id='3772655f9714408eb8a4bf4f843425dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51df0ba-0ab5-47ac-8070-e4ad54d6537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51df0ba-0ab5-47ac-8070-e4ad54d6537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866b18f3-d2e2-4557-a5b6-7bb6c10a4d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866b18f3-d2e2-4557-a5b6-7bb6c10a4d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305afffe-ae58-4583-b8d9-5d3db9028779', 'volume_name': 'volume-305afffe-ae58-4583-b8d9-5d3db9028779', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e4bd92-f263-4ec8-9103-87527010fe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e4bd92-f263-4ec8-9103-87527010fe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21113c7-26f8-439b-895f-13703e2df6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Volume 305afffe-ae58-4583-b8d9-5d3db9028779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305afffe-ae58-4583-b8d9-5d3db9028779', 'volume_size': 1} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1254788552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305afffe-ae58-4583-b8d9-5d3db9028779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61056a4711974d56ad0a48b334c58475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:07:45Z,use_quota=True,user_id='3772655f9714408eb8a4bf4f843425dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Creating volume 305afffe-ae58-4583-b8d9-5d3db9028779 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:07:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:07:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:44 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779 1073741824 Sep 28 19:07:44 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:45 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779 1073741824" returned: 0 in 0.808s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:45 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779 Sep 28 19:07:45 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:46 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779" returned: 0 in 0.397s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:07:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21113c7-26f8-439b-895f-13703e2df6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305afffe-ae58-4583-b8d9-5d3db9028779', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc86bdb-3ed1-4b63-a4b0-8b89f1666ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:07:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Volume volume-305afffe-ae58-4583-b8d9-5d3db9028779 (305afffe-ae58-4583-b8d9-5d3db9028779): created successfully Sep 28 19:07:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc86bdb-3ed1-4b63-a4b0-8b89f1666ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:07:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Flow 'volume_create_manager' (032c5129-46c4-449d-bc61-4a43715514cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:07:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-228d3f90-8573-4036-b248-eadd19df187b tempest-VolumesMetadataTest-1304095151 None] Created volume successfully. Sep 28 19:07:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Acquiring lock "cinder-305afffe-ae58-4583-b8d9-5d3db9028779-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Lock "cinder-305afffe-ae58-4583-b8d9-5d3db9028779-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Acquiring lock "cinder-quobyte-305afffe-ae58-4583-b8d9-5d3db9028779" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:07:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Lock "cinder-quobyte-305afffe-ae58-4583-b8d9-5d3db9028779" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:07:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5bd112-6f6a-4786-afe9-ad4a69b7ca33]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:07:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:48 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779 Sep 28 19:07:48 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:49 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779" returned: 0 in 0.684s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:49 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779 Sep 28 19:07:49 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:49 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-305afffe-ae58-4583-b8d9-5d3db9028779" returned: 0 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Lock "cinder-quobyte-305afffe-ae58-4583-b8d9-5d3db9028779" released by "delete_volume" :: held 1.130s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:49 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Created reservations ['418b1012-06d6-4cf1-966d-fbb975615078', '9184c341-ef49-4fa8-bf15-03e877c93190', 'e5bb9761-13a4-480e-a035-a45200dfe5d2', 'f275a0ae-2837-4b65-b83e-5e112323f97d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:07:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:07:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:07:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:07:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:07:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:07:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:07:50 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:07:50 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:07:50 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Sep 28 19:07:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:07:50 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:07:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Deleted volume successfully. Sep 28 19:07:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d8601051-a51e-4481-826e-b070876a4aea tempest-VolumesMetadataTest-1304095151 None] Lock "cinder-305afffe-ae58-4583-b8d9-5d3db9028779-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:07:59 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:08:00 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=12,cinder:SELECT=6,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Flow 'volume_create_manager' (94e42c56-f95c-4f72-a78a-6cd352eafbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d92cc02-f61a-4ad2-bbf7-323c243d2519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d92cc02-f61a-4ad2-bbf7-323c243d2519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-438415380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6ba720-25b5-4fab-b53b-97e1276bdbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1369e63f50144040b16ffe97298841b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:03Z,use_quota=True,user_id='80533791e14049b4a076119a89d47ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17dc67fa-772e-4b61-99cb-2eba46f8cd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17dc67fa-772e-4b61-99cb-2eba46f8cd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fc4a86-9937-49b5-a6c6-aeeaa0d3c9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fc4a86-9937-49b5-a6c6-aeeaa0d3c9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6ba720-25b5-4fab-b53b-97e1276bdbda', 'volume_name': 'volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08458961-03f6-4444-9d68-ba4cb1c57b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08458961-03f6-4444-9d68-ba4cb1c57b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f9eb44-7901-4e88-b380-5ebae0c5b3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:03 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Volume eb6ba720-25b5-4fab-b53b-97e1276bdbda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda', 'volume_size': 1} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-438415380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6ba720-25b5-4fab-b53b-97e1276bdbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1369e63f50144040b16ffe97298841b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:03Z,use_quota=True,user_id='80533791e14049b4a076119a89d47ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Creating volume eb6ba720-25b5-4fab-b53b-97e1276bdbda {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:08:03 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:08:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:03 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda 1073741824 Sep 28 19:08:03 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:04 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda 1073741824" returned: 0 in 1.125s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:04 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda Sep 28 19:08:04 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:05 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda" returned: 0 in 0.587s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:08:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f9eb44-7901-4e88-b380-5ebae0c5b3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf5694b-a223-46ed-a820-7357dd771239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Volume volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda (eb6ba720-25b5-4fab-b53b-97e1276bdbda): created successfully Sep 28 19:08:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf5694b-a223-46ed-a820-7357dd771239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Flow 'volume_create_manager' (94e42c56-f95c-4f72-a78a-6cd352eafbf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2123df6a-5dfd-4ff6-be98-dc104d656bb7 tempest-VolumesTransfersTest-1843259051 None] Created volume successfully. Sep 28 19:08:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a757097a-699c-4d70-8280-f5db972c2b0c tempest-VolumesTransfersTest-739347713 None] Transfer volume completed successfully. Sep 28 19:08:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Acquiring lock "cinder-eb6ba720-25b5-4fab-b53b-97e1276bdbda-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Lock "cinder-eb6ba720-25b5-4fab-b53b-97e1276bdbda-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Acquiring lock "cinder-quobyte-eb6ba720-25b5-4fab-b53b-97e1276bdbda" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Lock "cinder-quobyte-eb6ba720-25b5-4fab-b53b-97e1276bdbda" acquired by "delete_volume" :: waited 0.048s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24241b9-9c1c-429d-aa36-3682f34776ce]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:08:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:10 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda Sep 28 19:08:10 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:11 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda" returned: 0 in 0.997s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:11 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda Sep 28 19:08:11 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:11 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-eb6ba720-25b5-4fab-b53b-97e1276bdbda" returned: 0 in 0.476s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Lock "cinder-quobyte-eb6ba720-25b5-4fab-b53b-97e1276bdbda" released by "delete_volume" :: held 1.587s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:12 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Created reservations ['7eb64399-2a6f-4f2f-b1f4-b0e08433914e', 'ebf4d8ef-2a63-4676-8924-ec26cf8299ae', '6365f936-d2da-4f7e-a09c-4fdb99a7400a', 'b2e84378-1616-4dd5-9cae-9497df4ff06a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:08:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:12 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:08:12 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:13 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.695s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:13 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:08:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Deleted volume successfully. Sep 28 19:08:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f3450460-4eb0-4490-878f-08030fd6b5f8 tempest-VolumesTransfersTest-126391950 None] Lock "cinder-eb6ba720-25b5-4fab-b53b-97e1276bdbda-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Flow 'volume_create_manager' (74625133-90e4-4395-bebb-24b3018a528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6cf5de-72e2-4a7b-922f-1887bfe34b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6cf5de-72e2-4a7b-922f-1887bfe34b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1978071427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3dd3dc-2145-4612-80f7-89d6470f77c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1369e63f50144040b16ffe97298841b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:14Z,use_quota=True,user_id='80533791e14049b4a076119a89d47ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625bbe06-685b-48a5-946e-955dc8c5ef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625bbe06-685b-48a5-946e-955dc8c5ef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8252ac5f-d685-40b6-bd62-b18d2b299fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8252ac5f-d685-40b6-bd62-b18d2b299fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c3dd3dc-2145-4612-80f7-89d6470f77c8', 'volume_name': 'volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e7cb0c-2f7e-489f-baa3-3c507e995c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e7cb0c-2f7e-489f-baa3-3c507e995c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fb8606-5a81-4a88-b954-1f6379243eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Volume 6c3dd3dc-2145-4612-80f7-89d6470f77c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8', 'volume_size': 1} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1978071427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3dd3dc-2145-4612-80f7-89d6470f77c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1369e63f50144040b16ffe97298841b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:14Z,use_quota=True,user_id='80533791e14049b4a076119a89d47ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Creating volume 6c3dd3dc-2145-4612-80f7-89d6470f77c8 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:08:14 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:08:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:14 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8 1073741824 Sep 28 19:08:14 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:15 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8 1073741824" returned: 0 in 0.803s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:15 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8 Sep 28 19:08:15 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:15 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:08:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fb8606-5a81-4a88-b954-1f6379243eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb25915-ab27-4d25-842b-e0bbaba6d933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Volume volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8 (6c3dd3dc-2145-4612-80f7-89d6470f77c8): created successfully Sep 28 19:08:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb25915-ab27-4d25-842b-e0bbaba6d933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Flow 'volume_create_manager' (74625133-90e4-4395-bebb-24b3018a528f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-67bb7bd8-bade-481c-9ea0-d2d64cb6d0cc tempest-VolumesTransfersTest-1843259051 None] Created volume successfully. Sep 28 19:08:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Acquiring lock "cinder-6c3dd3dc-2145-4612-80f7-89d6470f77c8-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Lock "cinder-6c3dd3dc-2145-4612-80f7-89d6470f77c8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Acquiring lock "cinder-quobyte-6c3dd3dc-2145-4612-80f7-89d6470f77c8" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Lock "cinder-quobyte-6c3dd3dc-2145-4612-80f7-89d6470f77c8" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5668456-8ed0-428d-92aa-52461abee470]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:08:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:16 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8 Sep 28 19:08:16 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:17 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8" returned: 0 in 0.466s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:17 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8 Sep 28 19:08:17 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:17 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c3dd3dc-2145-4612-80f7-89d6470f77c8" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Lock "cinder-quobyte-6c3dd3dc-2145-4612-80f7-89d6470f77c8" released by "delete_volume" :: held 0.890s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Created reservations ['6c5ffbc9-c521-4d2d-a513-8de0a6f1546a', '8d0565c4-ed23-49a9-aae3-e8fab78d6283', '7b066c78-c4ff-4ebf-aa6c-97ba4c551b64', 'e4b020ba-35cb-4762-bc9d-05482c708177'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:17 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:08:17 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:18 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.395s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:18 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:08:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Deleted volume successfully. Sep 28 19:08:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb21223a-b7fa-44b1-8066-20bc0685adce tempest-VolumesTransfersTest-126391950 None] Lock "cinder-6c3dd3dc-2145-4612-80f7-89d6470f77c8-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Flow 'volume_create_manager' (af2a21b4-d824-4637-9f36-784db618fdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cd66e6-cadb-4bf9-973e-417d87affeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cd66e6-cadb-4bf9-973e-417d87affeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-843578999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ecdcb6a-120d-4f07-bfcc-e604f87d9876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609bf4c760304816ab28fc6fd505fd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:25Z,use_quota=True,user_id='b88ad40501414685a3ebc1913fe73186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefd58d8-29d4-47dd-be52-c12ffe5dac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefd58d8-29d4-47dd-be52-c12ffe5dac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd314677-2d85-4d17-a121-7a3d0f72a53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd314677-2d85-4d17-a121-7a3d0f72a53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ecdcb6a-120d-4f07-bfcc-e604f87d9876', 'volume_name': 'volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2c5d32-2eed-49a6-a9de-a2c1d08b6c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2c5d32-2eed-49a6-a9de-a2c1d08b6c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826cad49-49c8-42d0-af39-2e4a762e7919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Volume 5ecdcb6a-120d-4f07-bfcc-e604f87d9876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876', 'volume_size': 1} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-843578999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ecdcb6a-120d-4f07-bfcc-e604f87d9876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609bf4c760304816ab28fc6fd505fd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:25Z,use_quota=True,user_id='b88ad40501414685a3ebc1913fe73186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Creating volume 5ecdcb6a-120d-4f07-bfcc-e604f87d9876 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:08:25 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:25 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876 1073741824 Sep 28 19:08:25 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:25 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876 1073741824" returned: 0 in 0.607s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:25 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876 Sep 28 19:08:25 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:26 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876" returned: 0 in 0.517s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:08:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826cad49-49c8-42d0-af39-2e4a762e7919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58fccba-a62e-4b26-86d3-04bf2fd75c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:26 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Volume volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876 (5ecdcb6a-120d-4f07-bfcc-e604f87d9876): created successfully Sep 28 19:08:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58fccba-a62e-4b26-86d3-04bf2fd75c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Flow 'volume_create_manager' (af2a21b4-d824-4637-9f36-784db618fdda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-69869a6d-1041-47fa-ad8e-2cccd276d38d tempest-AttachVolumeNegativeTest-969719363 None] Created volume successfully. Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Flow 'volume_create_manager' (9eeb5770-5d53-4ec3-93dc-a2eb4ff80a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3080e0df-9bb1-4ba6-aefd-464746271031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3080e0df-9bb1-4ba6-aefd-464746271031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1807163849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086d226d-5aeb-4803-b0d0-d71a0c60d93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077360d84cbc40e0a52bf36e8ab6894e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:28Z,use_quota=True,user_id='627f7a44544b4a76b255eb5f58139f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbbb5c7-bade-4f61-b45a-ef83b42f64f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbbb5c7-bade-4f61-b45a-ef83b42f64f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81026339-6bf3-4b80-86a7-edcde36c8105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81026339-6bf3-4b80-86a7-edcde36c8105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086d226d-5aeb-4803-b0d0-d71a0c60d93e', 'volume_name': 'volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42be077e-bacb-448e-b128-c4d051029c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42be077e-bacb-448e-b128-c4d051029c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de971cc4-5f79-4d6f-9f82-6a5bd1c2bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Volume 086d226d-5aeb-4803-b0d0-d71a0c60d93e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e', 'volume_size': 1} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1807163849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086d226d-5aeb-4803-b0d0-d71a0c60d93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077360d84cbc40e0a52bf36e8ab6894e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:28Z,use_quota=True,user_id='627f7a44544b4a76b255eb5f58139f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Creating volume 086d226d-5aeb-4803-b0d0-d71a0c60d93e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:08:28 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:28 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e 1073741824 Sep 28 19:08:28 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-adbe646d-893d-4b6d-9e3b-77d2be2bb69a req-afb95eca-af3d-4e13-8f5c-1b0719f51f67 tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Flow 'volume_create_manager' (8d1e7a02-eff7-40f4-afa5-44faee8c2ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4163dc9-55ad-4d19-833f-62eab4913167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4163dc9-55ad-4d19-833f-62eab4913167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1144103668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7abb1f6-13a8-453e-a0de-bbace533be79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88accd5838954d15afb5fa846c01a42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:29Z,use_quota=True,user_id='d56416dfbce046a39209585026a4053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa41e5c6-90b9-4101-a267-052b67c84990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa41e5c6-90b9-4101-a267-052b67c84990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad42cc7-b849-4338-bdf6-df0f2bc08303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad42cc7-b849-4338-bdf6-df0f2bc08303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7abb1f6-13a8-453e-a0de-bbace533be79', 'volume_name': 'volume-b7abb1f6-13a8-453e-a0de-bbace533be79', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d4fdaf-5643-4085-b640-ede4c5629940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d4fdaf-5643-4085-b640-ede4c5629940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:29 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b692b6c-3c7b-49fa-8bdb-f25b0d06539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Volume b7abb1f6-13a8-453e-a0de-bbace533be79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7abb1f6-13a8-453e-a0de-bbace533be79', 'volume_size': 1} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e 1073741824" returned: 0 in 0.889s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:29 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e Sep 28 19:08:29 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:29 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e" returned: 0 in 0.306s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-adbe646d-893d-4b6d-9e3b-77d2be2bb69a req-afb95eca-af3d-4e13-8f5c-1b0719f51f67 tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.116s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-adbe646d-893d-4b6d-9e3b-77d2be2bb69a req-afb95eca-af3d-4e13-8f5c-1b0719f51f67 tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1144103668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7abb1f6-13a8-453e-a0de-bbace533be79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88accd5838954d15afb5fa846c01a42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:29Z,use_quota=True,user_id='d56416dfbce046a39209585026a4053e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Creating volume b7abb1f6-13a8-453e-a0de-bbace533be79 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:08:29 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de971cc4-5f79-4d6f-9f82-6a5bd1c2bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb78cf2-49d5-4165-9a86-ce9c3b10597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:29 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79 1073741824 Sep 28 19:08:29 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Volume volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e (086d226d-5aeb-4803-b0d0-d71a0c60d93e): created successfully Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb78cf2-49d5-4165-9a86-ce9c3b10597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Flow 'volume_create_manager' (9eeb5770-5d53-4ec3-93dc-a2eb4ff80a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2f6c0988-28fe-48f8-9c11-6fe9bb87aa4e tempest-VolumesCloneTest-1389632113 None] Created volume successfully. Sep 28 19:08:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-adbe646d-893d-4b6d-9e3b-77d2be2bb69a req-afb95eca-af3d-4e13-8f5c-1b0719f51f67 tempest-AttachVolumeNegativeTest-969719363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8b1883f-464b-43c2-8ad3-d4e8d06b4b77', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:08:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-adbe646d-893d-4b6d-9e3b-77d2be2bb69a req-afb95eca-af3d-4e13-8f5c-1b0719f51f67 tempest-AttachVolumeNegativeTest-969719363 None] attachment_update completed successfully. Sep 28 19:08:30 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79 1073741824" returned: 0 in 0.651s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:30 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79 Sep 28 19:08:30 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:30 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79" returned: 0 in 0.414s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:08:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b692b6c-3c7b-49fa-8bdb-f25b0d06539b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7abb1f6-13a8-453e-a0de-bbace533be79', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285ae148-6345-41e4-89a7-11d6c333b35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:30 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Volume volume-b7abb1f6-13a8-453e-a0de-bbace533be79 (b7abb1f6-13a8-453e-a0de-bbace533be79): created successfully Sep 28 19:08:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285ae148-6345-41e4-89a7-11d6c333b35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Flow 'volume_create_manager' (8d1e7a02-eff7-40f4-afa5-44faee8c2ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f9f6aef5-6851-4ce2-ad94-55c7009f065f tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Created volume successfully. Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Flow 'volume_create_manager' (0f364b82-6777-49e6-959e-8d4966881a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddad102-04c8-4187-ba0e-ea8e8e29b275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddad102-04c8-4187-ba0e-ea8e8e29b275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-129557251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0de3ff-2e31-4bd1-97f4-166ffb6d5352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077360d84cbc40e0a52bf36e8ab6894e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=086d226d-5aeb-4803-b0d0-d71a0c60d93e,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:31Z,use_quota=True,user_id='627f7a44544b4a76b255eb5f58139f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da10093-c8ba-4b1c-83d0-61e64f9a5f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da10093-c8ba-4b1c-83d0-61e64f9a5f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f82511-7408-4bc1-be13-2f3786100905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f82511-7408-4bc1-be13-2f3786100905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'be0de3ff-2e31-4bd1-97f4-166ffb6d5352', 'volume_name': 'volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352', 'volume_size': 2, 'source_volid': '086d226d-5aeb-4803-b0d0-d71a0c60d93e', 'source_volstatus': 'available'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bb3bed-0953-49c3-a95f-7879687dbd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bb3bed-0953-49c3-a95f-7879687dbd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f518df-260e-44de-be33-8abd6ef21f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Volume be0de3ff-2e31-4bd1-97f4-166ffb6d5352: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352', 'volume_size': 2, 'source_volid': '086d226d-5aeb-4803-b0d0-d71a0c60d93e', 'source_volstatus': 'available'} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Cloning volume 086d226d-5aeb-4803-b0d0-d71a0c60d93e to volume be0de3ff-2e31-4bd1-97f4-166ffb6d5352 Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Creating offline snapshot 104ed470-78d8-45a9-b89e-271c081ec07b of volume 086d226d-5aeb-4803-b0d0-d71a0c60d93e {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[db707301-baba-4859-8ec1-cb18d48c3799]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:31 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e Sep 28 19:08:31 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:31 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e" returned: 0 in 0.542s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:32 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b 1G Sep 28 19:08:32 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-fab62ab7-693f-4e10-a11a-46f467b120be req-12bbc205-5cbf-4af1-8c8d-1b535bcf25b4 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:32 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b 1G" returned: 0 in 0.793s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:32 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b Sep 28 19:08:32 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:33 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b" returned: 0 in 0.440s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:33 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b is being set with open permissions: ugo+rw Sep 28 19:08:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:33 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b Sep 28 19:08:33 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:33 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:33 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.info Sep 28 19:08:33 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:33 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.info" returned: 0 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:33 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.info is being set with open permissions: ugo+rw Sep 28 19:08:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:34 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.info Sep 28 19:08:34 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:34 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.info" returned: 0 in 0.378s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Acquiring lock "cinder-quobyte-be0de3ff-2e31-4bd1-97f4-166ffb6d5352" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Lock "cinder-quobyte-be0de3ff-2e31-4bd1-97f4-166ffb6d5352" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] snapshot: 104ed470-78d8-45a9-b89e-271c081ec07b, volume: be0de3ff-2e31-4bd1-97f4-166ffb6d5352, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1e4250-4b77-4015-972f-79e6128241da]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:34 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b Sep 28 19:08:34 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:34 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:08:34 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:35 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:08:35 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b" returned: 0 in 0.619s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c489106-0040-4ab3-bb7b-db20d4818880]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:35 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e Sep 28 19:08:35 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:35 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e" returned: 0 in 0.541s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:08:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:35 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 Sep 28 19:08:35 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:43 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=29,cinder:SELECT=33,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:08:43 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=31,cinder:UPDATE=38,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:08:47 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352" returned: 0 in 12.270s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:47 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e, size 1024.00 MB, duration 12.27 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:08:47 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Converted 1024.00 MB image at 83.44 MB/s Sep 28 19:08:47 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 is being set with open permissions: ugo+rw Sep 28 19:08:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:48 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 Sep 28 19:08:48 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (c99e5089-e105-470e-a4f9-1ac3d6673e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4466095-45e6-49d2-a3ea-588d16fc46d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4466095-45e6-49d2-a3ea-588d16fc46d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-150230074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4eca030-aa80-48b0-8438-240a33b27de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:48Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a46ca1-ccfa-470a-b752-f81c2719690a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a46ca1-ccfa-470a-b752-f81c2719690a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62ee649-9ec1-4e01-9867-dda5316a9c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62ee649-9ec1-4e01-9867-dda5316a9c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4eca030-aa80-48b0-8438-240a33b27de2', 'volume_name': 'volume-c4eca030-aa80-48b0-8438-240a33b27de2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e31164-70b8-4723-b85e-ce4953191530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e31164-70b8-4723-b85e-ce4953191530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0f4c9f-7f5e-4aeb-b566-379b3594083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Volume c4eca030-aa80-48b0-8438-240a33b27de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4eca030-aa80-48b0-8438-240a33b27de2', 'volume_size': 1} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:48 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352" returned: 0 in 0.453s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Lock "cinder-quobyte-be0de3ff-2e31-4bd1-97f4-166ffb6d5352" released by "_copy_volume_from_snapshot" :: held 14.017s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Acquiring lock "cinder-quobyte-104ed470-78d8-45a9-b89e-271c081ec07b" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Lock "cinder-quobyte-104ed470-78d8-45a9-b89e-271c081ec07b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Deleting offline snapshot 104ed470-78d8-45a9-b89e-271c081ec07b of volume 086d226d-5aeb-4803-b0d0-d71a0c60d93e {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] snapshot_file for this snap is: volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8c7aad-d382-4332-9860-fa14ba7e9c31]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:08:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:48 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b Sep 28 19:08:48 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:49 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b" returned: 0 in 0.775s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:08:49 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc97520-3253-449b-a21c-60e857abda8f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:08:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:49 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e Sep 28 19:08:49 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:50 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e" returned: 0 in 1.435s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:50 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b Sep 28 19:08:50 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:51 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b" returned: 0 in 0.450s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:51 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b Sep 28 19:08:51 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:51 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e.104ed470-78d8-45a9-b89e-271c081ec07b" returned: 0 in 0.412s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Lock "cinder-quobyte-104ed470-78d8-45a9-b89e-271c081ec07b" released by "_delete_snapshot" :: held 3.280s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.514s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-fab62ab7-693f-4e10-a11a-46f467b120be req-12bbc205-5cbf-4af1-8c8d-1b535bcf25b4 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.204s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-fab62ab7-693f-4e10-a11a-46f467b120be req-12bbc205-5cbf-4af1-8c8d-1b535bcf25b4 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.564s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-150230074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4eca030-aa80-48b0-8438-240a33b27de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:08:48Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Creating volume c4eca030-aa80-48b0-8438-240a33b27de2 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:08:51 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f518df-260e-44de-be33-8abd6ef21f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352', 'volume_size': 2, 'source_volid': '086d226d-5aeb-4803-b0d0-d71a0c60d93e', 'source_volstatus': 'available'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:51 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2 1073741824 Sep 28 19:08:51 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd97166-0042-4c2e-b0f5-667bd6eba9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Volume volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 (be0de3ff-2e31-4bd1-97f4-166ffb6d5352): created successfully Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd97166-0042-4c2e-b0f5-667bd6eba9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Flow 'volume_create_manager' (0f364b82-6777-49e6-959e-8d4966881a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-fab62ab7-693f-4e10-a11a-46f467b120be req-12bbc205-5cbf-4af1-8c8d-1b535bcf25b4 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-b7abb1f6-13a8-453e-a0de-bbace533be79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe1d9fbc-0a1a-4ba7-9167-f56e2a800282', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:08:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a631bb92-fc03-465f-9fc6-1d3cbcbc2995 tempest-VolumesCloneTest-1389632113 None] Created volume successfully. Sep 28 19:08:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-fab62ab7-693f-4e10-a11a-46f467b120be req-12bbc205-5cbf-4af1-8c8d-1b535bcf25b4 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] attachment_update completed successfully. Sep 28 19:08:53 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2 1073741824" returned: 0 in 1.211s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:53 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2 Sep 28 19:08:53 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:53 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2" returned: 0 in 0.739s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:08:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0f4c9f-7f5e-4aeb-b566-379b3594083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4eca030-aa80-48b0-8438-240a33b27de2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4857bd-9d5e-4a19-8e59-988ffb6470db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:08:53 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Volume volume-c4eca030-aa80-48b0-8438-240a33b27de2 (c4eca030-aa80-48b0-8438-240a33b27de2): created successfully Sep 28 19:08:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4857bd-9d5e-4a19-8e59-988ffb6470db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:08:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (c99e5089-e105-470e-a4f9-1ac3d6673e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:08:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Acquiring lock "cinder-be0de3ff-2e31-4bd1-97f4-166ffb6d5352-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-52b8c825-99b3-40c7-8f5a-9c8788f0e897 tempest-VolumesActionsTest-17280824 None] Created volume successfully. Sep 28 19:08:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Lock "cinder-be0de3ff-2e31-4bd1-97f4-166ffb6d5352-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Acquiring lock "cinder-quobyte-be0de3ff-2e31-4bd1-97f4-166ffb6d5352" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Lock "cinder-quobyte-be0de3ff-2e31-4bd1-97f4-166ffb6d5352" acquired by "delete_volume" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f0d38665-dc56-4c2f-8e7f-0a3809750f9a tempest-VolumesActionsTest-17280824 None] Acquiring lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2" by "attach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:54 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2749452-9892-465d-b19f-7414737a7c59]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:08:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f0d38665-dc56-4c2f-8e7f-0a3809750f9a tempest-VolumesActionsTest-17280824 None] Lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2" acquired by "attach_volume" :: waited 0.079s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f0d38665-dc56-4c2f-8e7f-0a3809750f9a tempest-VolumesActionsTest-17280824 None] Attaching volume c4eca030-aa80-48b0-8438-240a33b27de2 to instance 4efa4ab3-b875-40ec-905c-b56f588204d4 at mountpoint /dev/vdb on host None. Sep 28 19:08:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f0d38665-dc56-4c2f-8e7f-0a3809750f9a tempest-VolumesActionsTest-17280824 None] Attach volume completed successfully. Sep 28 19:08:54 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 Sep 28 19:08:54 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f0d38665-dc56-4c2f-8e7f-0a3809750f9a tempest-VolumesActionsTest-17280824 None] Lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2" released by "attach_volume" :: held 0.213s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:55 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352" returned: 0 in 0.775s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:55 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352 Sep 28 19:08:55 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:56 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-be0de3ff-2e31-4bd1-97f4-166ffb6d5352" returned: 0 in 0.866s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Lock "cinder-quobyte-be0de3ff-2e31-4bd1-97f4-166ffb6d5352" released by "delete_volume" :: held 1.882s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-156c4e09-b2a7-4bd1-ab5c-23c66672e630 tempest-VolumesActionsTest-408773144 None] Terminate volume connection completed successfully. Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-156c4e09-b2a7-4bd1-ab5c-23c66672e630 tempest-VolumesActionsTest-408773144 None] Acquiring lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2-detach_volume" by "detach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Created reservations ['4b9452db-20b8-4fac-a137-15b446cd11f0', '28644578-89ea-42d1-b0e2-2a9ea6d8655c', '6551f713-9c5f-4f8a-b248-bebcfb7e6775', '1f0bd0fe-e11c-404b-b2be-dabcf8c1ea42'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-156c4e09-b2a7-4bd1-ab5c-23c66672e630 tempest-VolumesActionsTest-408773144 None] Lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-156c4e09-b2a7-4bd1-ab5c-23c66672e630 tempest-VolumesActionsTest-408773144 None] Detaching volume c4eca030-aa80-48b0-8438-240a33b27de2 from instance 4efa4ab3-b875-40ec-905c-b56f588204d4. Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-156c4e09-b2a7-4bd1-ab5c-23c66672e630 tempest-VolumesActionsTest-408773144 None] Detach volume completed successfully. Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-156c4e09-b2a7-4bd1-ab5c-23c66672e630 tempest-VolumesActionsTest-408773144 None] Lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2-detach_volume" released by "detach_volume" :: held 0.212s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:56 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:08:56 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d04757ad-3f7f-40fc-a679-749a9724ce16 tempest-VolumesActionsTest-17280824 None] Acquiring lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2-detach_volume" by "detach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:56 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.465s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:57 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:08:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d04757ad-3f7f-40fc-a679-749a9724ce16 tempest-VolumesActionsTest-17280824 None] Lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2-detach_volume" acquired by "detach_volume" :: waited 0.065s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d04757ad-3f7f-40fc-a679-749a9724ce16 tempest-VolumesActionsTest-17280824 None] Volume detach called, but volume not attached. Sep 28 19:08:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Deleted volume successfully. Sep 28 19:08:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d04757ad-3f7f-40fc-a679-749a9724ce16 tempest-VolumesActionsTest-17280824 None] Lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-326d3a5a-41fb-4895-a806-0ccbeb2082fd tempest-VolumesCloneTest-1389632113 None] Lock "cinder-be0de3ff-2e31-4bd1-97f4-166ffb6d5352-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Acquiring lock "cinder-086d226d-5aeb-4803-b0d0-d71a0c60d93e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Lock "cinder-086d226d-5aeb-4803-b0d0-d71a0c60d93e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Acquiring lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Acquiring lock "cinder-quobyte-086d226d-5aeb-4803-b0d0-d71a0c60d93e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Lock "cinder-quobyte-086d226d-5aeb-4803-b0d0-d71a0c60d93e" acquired by "delete_volume" :: waited 0.123s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[463f8027-63f4-4cde-8609-3796f62a50dc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Acquiring lock "cinder-quobyte-c4eca030-aa80-48b0-8438-240a33b27de2" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Lock "cinder-quobyte-c4eca030-aa80-48b0-8438-240a33b27de2" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:58 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e Sep 28 19:08:58 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e653736-691f-488b-9c5e-c4e77168e0d1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:58 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2 Sep 28 19:08:58 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:58 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e" returned: 0 in 0.589s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:58 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e Sep 28 19:08:58 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:58 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2" returned: 0 in 0.545s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:59 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2 Sep 28 19:08:59 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-18c04eb5-17dc-4855-823c-b5abe2f0c689 req-02d6c594-1250-433d-90c6-4115af2f3f23 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Terminate volume connection completed successfully. Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-18c04eb5-17dc-4855-823c-b5abe2f0c689 req-02d6c594-1250-433d-90c6-4115af2f3f23 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Deleting attachment fe1d9fbc-0a1a-4ba7-9167-f56e2a800282. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:08:59 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-086d226d-5aeb-4803-b0d0-d71a0c60d93e" returned: 0 in 0.517s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Lock "cinder-quobyte-086d226d-5aeb-4803-b0d0-d71a0c60d93e" released by "delete_volume" :: held 1.324s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Created reservations ['376c1975-0a99-4ab9-9165-c79c66081892', 'ee09dc0e-eb46-4ffe-95cb-d3a8cb60c172', '147bb169-c597-4f25-8655-c6534d472e0c', '8203e57c-523b-4052-885a-ed6e0762e2b8'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:08:59 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c4eca030-aa80-48b0-8438-240a33b27de2" returned: 0 in 0.621s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Lock "cinder-quobyte-c4eca030-aa80-48b0-8438-240a33b27de2" released by "delete_volume" :: held 1.269s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:59 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:08:59 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Created reservations ['9e081f72-6f9e-4bbd-ac01-b98a4c79fc11', '344808d6-bbef-43ac-8c65-d61a08541137', '4a7f0e7a-5c26-4775-87a5-e5bcc39b9fbf', '174fdb69-7263-4403-b0e9-2707aab54bee'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Acquiring lock "cinder-b7abb1f6-13a8-453e-a0de-bbace533be79-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "cinder-b7abb1f6-13a8-453e-a0de-bbace533be79-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:08:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Acquiring lock "cinder-quobyte-b7abb1f6-13a8-453e-a0de-bbace533be79" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "cinder-quobyte-b7abb1f6-13a8-453e-a0de-bbace533be79" acquired by "delete_volume" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:00 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:00 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:00 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a035d292-d8fa-4e66-bde9-fe1c18c82024]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.384s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Deleted volume successfully. Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3fc5731c-35d4-4c01-828f-5ca2e8653578 tempest-VolumesCloneTest-1389632113 None] Lock "cinder-086d226d-5aeb-4803-b0d0-d71a0c60d93e-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:00 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79 Sep 28 19:09:00 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:00 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.470s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Deleted volume successfully. Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0554a0aa-751f-4865-af34-886f3843a029 tempest-VolumesActionsTest-17280824 None] Lock "cinder-c4eca030-aa80-48b0-8438-240a33b27de2-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:00 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79" returned: 0 in 0.676s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:00 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79 Sep 28 19:09:00 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:01 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b7abb1f6-13a8-453e-a0de-bbace533be79" returned: 0 in 0.459s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "cinder-quobyte-b7abb1f6-13a8-453e-a0de-bbace533be79" released by "delete_volume" :: held 1.225s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:01 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Created reservations ['9b74f6a8-dd3c-4a62-8fd0-38a675545eac', '2e4c77eb-1d28-4073-8464-143c82e819c7', 'e0465ef2-2b64-42ec-8f18-3576e8905200', '2ef13931-6666-4bbe-96de-694a643607b3'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:01 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:01 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:02 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.382s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:02 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Deleted volume successfully. Sep 28 19:09:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b089193-02de-4c33-a796-2187b12c5017 tempest-TestServerVolumeAttachScenarioOldVersion-771031735 None] Lock "cinder-b7abb1f6-13a8-453e-a0de-bbace533be79-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (396cd2c3-6f88-403c-8c97-cad9314cfa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f702e8d1-9f8d-403a-9f5a-5bea8f2ae7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f702e8d1-9f8d-403a-9f5a-5bea8f2ae7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1726647392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171d2fa3-1a9d-4b79-8e73-b4648839c725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:07Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503b5dfe-a61c-4a70-af9d-2f370b6a4f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503b5dfe-a61c-4a70-af9d-2f370b6a4f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c627ab1a-097c-4c75-9d77-791db52f49a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c627ab1a-097c-4c75-9d77-791db52f49a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171d2fa3-1a9d-4b79-8e73-b4648839c725', 'volume_name': 'volume-171d2fa3-1a9d-4b79-8e73-b4648839c725', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92339f9a-7b3f-4afa-be34-d6ef4afa0dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92339f9a-7b3f-4afa-be34-d6ef4afa0dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92aa5e7-4043-41de-970c-9b1a74bf80d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:06 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Volume 171d2fa3-1a9d-4b79-8e73-b4648839c725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171d2fa3-1a9d-4b79-8e73-b4648839c725', 'volume_size': 1} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1726647392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171d2fa3-1a9d-4b79-8e73-b4648839c725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:07Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Creating volume 171d2fa3-1a9d-4b79-8e73-b4648839c725 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:07 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:07 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725 1073741824 Sep 28 19:09:07 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:07 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725 1073741824" returned: 0 in 0.717s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:07 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725 Sep 28 19:09:07 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:08 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92aa5e7-4043-41de-970c-9b1a74bf80d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171d2fa3-1a9d-4b79-8e73-b4648839c725', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5debce81-def0-41d6-9740-1644dcc5402c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Volume volume-171d2fa3-1a9d-4b79-8e73-b4648839c725 (171d2fa3-1a9d-4b79-8e73-b4648839c725): created successfully Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5debce81-def0-41d6-9740-1644dcc5402c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (396cd2c3-6f88-403c-8c97-cad9314cfa10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d43e715d-7a4d-4ea6-a00a-2b6cc8063d20 tempest-VolumesActionsTest-17280824 None] Created volume successfully. Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (3117f653-74f2-41e2-9f86-c0dcb7f3e99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d232b8c1-8797-4035-8b31-c6992373aa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d232b8c1-8797-4035-8b31-c6992373aa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-114187889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:09Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d841a17-efbf-4723-bf0f-1cfa931c2d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d841a17-efbf-4723-bf0f-1cfa931c2d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2e45dd-ac8b-4260-b03b-669609cbd4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2e45dd-ac8b-4260-b03b-669609cbd4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c', 'volume_name': 'volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bc125b-01dc-423c-984f-42285020954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bc125b-01dc-423c-984f-42285020954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b22db2-cd9d-4749-a71d-847f939c51f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Volume b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c', 'volume_size': 1} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-114187889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:09Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Creating volume b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:08 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:08 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c 1073741824 Sep 28 19:09:08 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Acquiring lock "cinder-171d2fa3-1a9d-4b79-8e73-b4648839c725-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Lock "cinder-171d2fa3-1a9d-4b79-8e73-b4648839c725-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Acquiring lock "cinder-quobyte-171d2fa3-1a9d-4b79-8e73-b4648839c725" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Lock "cinder-quobyte-171d2fa3-1a9d-4b79-8e73-b4648839c725" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabecaf7-c86d-44e5-9818-ab3ff7ce8074]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:09 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725 Sep 28 19:09:09 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:09 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c 1073741824" returned: 0 in 0.634s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:09 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c Sep 28 19:09:09 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:09 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725" returned: 0 in 0.493s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:09 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725 Sep 28 19:09:09 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:09 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b22db2-cd9d-4749-a71d-847f939c51f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc3a099-2c26-4b9c-9281-77a87b8b3756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Volume volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c (b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c): created successfully Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc3a099-2c26-4b9c-9281-77a87b8b3756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (3117f653-74f2-41e2-9f86-c0dcb7f3e99c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0a93b58a-47cc-464d-a341-452f832c5f83 tempest-VolumesGetTest-168182217 None] Created volume successfully. Sep 28 19:09:10 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-171d2fa3-1a9d-4b79-8e73-b4648839c725" returned: 0 in 0.324s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Lock "cinder-quobyte-171d2fa3-1a9d-4b79-8e73-b4648839c725" released by "delete_volume" :: held 0.870s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Created reservations ['e417d713-7870-4e3e-9a5f-dc8ff54e8de2', '11a59e57-e42c-47d6-afc7-abbf23de7ea1', 'a9834468-eaaa-48d8-9928-ad76eae63e6b', 'c129d7cd-989c-4588-b0e4-9f9f7c9c6355'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:10 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:10 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:10 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.331s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Deleted volume successfully. Sep 28 19:09:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b30e7606-7163-459a-b145-da3ce80b4702 tempest-VolumesActionsTest-408773144 None] Lock "cinder-171d2fa3-1a9d-4b79-8e73-b4648839c725-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (32cffcef-a7bd-4cd8-a4f9-4e4ad051e2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec950878-ab4c-4362-9aa1-c69f1030b0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec950878-ab4c-4362-9aa1-c69f1030b0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1306160260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:11Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4705e07b-44bc-4130-87a5-fb0af05da0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4705e07b-44bc-4130-87a5-fb0af05da0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6153cc31-45fe-4872-bb5c-a0a1cae63201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6153cc31-45fe-4872-bb5c-a0a1cae63201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6', 'volume_name': 'volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6add098-038e-4a3d-840f-4f27abe6e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6add098-038e-4a3d-840f-4f27abe6e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a1051c-3588-4656-bd0a-27c5eb9826b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Volume a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6', 'volume_size': 1} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1306160260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:11Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Creating volume a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:11 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:11 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 1073741824 Sep 28 19:09:11 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:11 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 1073741824" returned: 0 in 0.565s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:11 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 Sep 28 19:09:11 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (980f933c-f47d-4f5a-93a8-48e0cf93f1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08d592e-b352-4b87-a5ff-4f36e69a8866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08d592e-b352-4b87-a5ff-4f36e69a8866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-686965107',display_name='tempest-VolumesGetTest-Volume-1236743520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0088fa66-8573-46bd-900b-84c2253148d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:12Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1526a2-cec5-4694-bfb9-68eeda654f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1526a2-cec5-4694-bfb9-68eeda654f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef4f176-b2a7-48ab-af42-312b8a1e9230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef4f176-b2a7-48ab-af42-312b8a1e9230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0088fa66-8573-46bd-900b-84c2253148d7', 'volume_name': 'volume-0088fa66-8573-46bd-900b-84c2253148d7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b264640-7910-47f7-bff5-8e5236479ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b264640-7910-47f7-bff5-8e5236479ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945ebbfc-facf-480f-8839-1711e456e92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Volume 0088fa66-8573-46bd-900b-84c2253148d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0088fa66-8573-46bd-900b-84c2253148d7', 'volume_size': 1} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:12 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-686965107',display_name='tempest-VolumesGetTest-Volume-1236743520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0088fa66-8573-46bd-900b-84c2253148d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:12Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Creating volume 0088fa66-8573-46bd-900b-84c2253148d7 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:12 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a1051c-3588-4656-bd0a-27c5eb9826b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57441356-494d-494c-9823-e468c57caece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:12 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7 1073741824 Sep 28 19:09:12 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Volume volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 (a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6): created successfully Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57441356-494d-494c-9823-e468c57caece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (32cffcef-a7bd-4cd8-a4f9-4e4ad051e2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d9f1371b-73a4-45df-bee1-6b8a045a6f78 tempest-VolumesActionsTest-17280824 None] Created volume successfully. Sep 28 19:09:12 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7 1073741824" returned: 0 in 0.515s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:12 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7 Sep 28 19:09:12 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:13 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7" returned: 0 in 0.315s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945ebbfc-facf-480f-8839-1711e456e92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0088fa66-8573-46bd-900b-84c2253148d7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c671a5-f541-4043-93f6-e940b5b414a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Volume volume-0088fa66-8573-46bd-900b-84c2253148d7 (0088fa66-8573-46bd-900b-84c2253148d7): created successfully Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c671a5-f541-4043-93f6-e940b5b414a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (980f933c-f47d-4f5a-93a8-48e0cf93f1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b9463e74-3777-404d-88d9-d374755fd6a2 tempest-VolumesGetTest-168182217 None] Created volume successfully. Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Acquiring lock "cinder-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Lock "cinder-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Acquiring lock "cinder-quobyte-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Lock "cinder-quobyte-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9264b6-795c-40ae-8d87-c5618757d90f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:13 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 Sep 28 19:09:13 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:14 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6" returned: 0 in 0.533s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:14 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6 Sep 28 19:09:14 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-0088fa66-8573-46bd-900b-84c2253148d7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Lock "cinder-0088fa66-8573-46bd-900b-84c2253148d7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-quobyte-0088fa66-8573-46bd-900b-84c2253148d7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:14 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6" returned: 0 in 0.448s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-0088fa66-8573-46bd-900b-84c2253148d7" acquired by "delete_volume" :: waited 0.066s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Lock "cinder-quobyte-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6" released by "delete_volume" :: held 1.166s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e505da-e1b2-4033-bbbd-b541d3875e12]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Created reservations ['9dcf7693-46d4-4fb6-abbf-1dbce2f90bfc', '5226085c-ff3a-41ce-adf0-0a532c9f723f', 'a24a0f23-ed12-4add-a0ea-279c894d4adf', '790f16e5-58d9-41b6-9658-e1d0bcfbd682'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:14 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7 Sep 28 19:09:14 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:14 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:14 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:15 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.405s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Deleted volume successfully. Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-affcab1a-2b0d-45fa-a022-4255461f26d6 tempest-VolumesActionsTest-408773144 None] Lock "cinder-a9ec9b0b-b069-4125-bcb0-2eda70ff6bf6-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:15 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7" returned: 0 in 0.608s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:15 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7 Sep 28 19:09:15 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:15 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0088fa66-8573-46bd-900b-84c2253148d7" returned: 0 in 0.357s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-0088fa66-8573-46bd-900b-84c2253148d7" released by "delete_volume" :: held 1.161s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Created reservations ['d36d874a-7791-49eb-8f67-0fdb3ea20048', '2c3f7eee-bd81-4b94-88d2-cd4de3a6ccfb', 'dbcbe683-41a8-424a-bf52-7409e5f33fa3', 'aab0427e-f092-47c2-98be-267d22dce653'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:15 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:15 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:16 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.360s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Deleted volume successfully. Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-05aeeff5-f3d9-45cd-a64f-92eae2ce8041 tempest-VolumesGetTest-168182217 None] Lock "cinder-0088fa66-8573-46bd-900b-84c2253148d7-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (35b53575-4766-44a2-8526-75bbdcde6563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9fbde4e-5dc3-4e77-9c42-e1be4ab75aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9fbde4e-5dc3-4e77-9c42-e1be4ab75aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-741925217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516989e6-70de-46a0-aa8f-3b23a38ed292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:16Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eca8bf2-f72e-4085-8298-d4259443bddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eca8bf2-f72e-4085-8298-d4259443bddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e504df6-47b7-4575-82be-72a312d224c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e504df6-47b7-4575-82be-72a312d224c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516989e6-70de-46a0-aa8f-3b23a38ed292', 'volume_name': 'volume-516989e6-70de-46a0-aa8f-3b23a38ed292', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca186dd-e11f-43cc-80a1-6cd7dc7c43c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca186dd-e11f-43cc-80a1-6cd7dc7c43c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34d49c3-4686-4a71-8644-74d23d11a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Volume 516989e6-70de-46a0-aa8f-3b23a38ed292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516989e6-70de-46a0-aa8f-3b23a38ed292', 'volume_size': 1} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-741925217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516989e6-70de-46a0-aa8f-3b23a38ed292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:16Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Creating volume 516989e6-70de-46a0-aa8f-3b23a38ed292 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:16 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:16 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292 1073741824 Sep 28 19:09:16 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Lock "cinder-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-quobyte-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eff3d2-a3e9-4ee7-8748-62a54de32131]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:17 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c Sep 28 19:09:17 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:17 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292 1073741824" returned: 0 in 0.748s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:17 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292 Sep 28 19:09:17 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:17 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c" returned: 0 in 0.678s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:17 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c Sep 28 19:09:17 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:17 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292" returned: 0 in 0.409s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34d49c3-4686-4a71-8644-74d23d11a957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516989e6-70de-46a0-aa8f-3b23a38ed292', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7f6e97-fdb2-47a7-9a7b-2cd12ce79d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:18 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Volume volume-516989e6-70de-46a0-aa8f-3b23a38ed292 (516989e6-70de-46a0-aa8f-3b23a38ed292): created successfully Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7f6e97-fdb2-47a7-9a7b-2cd12ce79d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (35b53575-4766-44a2-8526-75bbdcde6563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6efb9ed0-d88f-4017-901a-62db413daeec tempest-VolumesActionsTest-17280824 None] Created volume successfully. Sep 28 19:09:18 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c" returned: 0 in 0.484s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c" released by "delete_volume" :: held 1.239s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Created reservations ['2c9f3adb-fc62-4f52-a5f1-572318c0e3c0', '6776496e-5fdd-4898-9f5e-f69638865585', 'b78cc4bb-1e24-41c2-8d6e-97075692cfba', '416ebdb4-1215-441e-a824-8b2f41132c87'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:18 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:18 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:18 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Deleted volume successfully. Sep 28 19:09:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2098b73-66b3-4c64-b725-b44eb5286f6b tempest-VolumesGetTest-168182217 None] Lock "cinder-b9ccaf36-2b7c-41d9-a436-a2f43eb4ed4c-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Acquiring lock "cinder-516989e6-70de-46a0-aa8f-3b23a38ed292-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Lock "cinder-516989e6-70de-46a0-aa8f-3b23a38ed292-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Acquiring lock "cinder-quobyte-516989e6-70de-46a0-aa8f-3b23a38ed292" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Lock "cinder-quobyte-516989e6-70de-46a0-aa8f-3b23a38ed292" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:19 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a03ccd-a09a-4037-bbb9-4b400a388bab]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:19 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292 Sep 28 19:09:19 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:19 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292" returned: 0 in 0.627s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:19 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292 Sep 28 19:09:19 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (97f3bb78-9ab3-43a5-b8a3-d565b9755d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbaf67b-c151-4c2b-bd8e-22b6b7ab1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbaf67b-c151-4c2b-bd8e-22b6b7ab1b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-978030083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13dba6a3-c6d1-4329-8112-638dc6f9e015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:20Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77aa57f0-1de6-420b-bef0-5192d08861e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77aa57f0-1de6-420b-bef0-5192d08861e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26901ee2-6b02-4f32-be3a-3770f1924d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26901ee2-6b02-4f32-be3a-3770f1924d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13dba6a3-c6d1-4329-8112-638dc6f9e015', 'volume_name': 'volume-13dba6a3-c6d1-4329-8112-638dc6f9e015', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6420a0c3-85b8-4ce8-b43b-844fb450972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6420a0c3-85b8-4ce8-b43b-844fb450972b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d8b3d6-28c4-4fda-bad4-346a89eb25d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:20 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Volume 13dba6a3-c6d1-4329-8112-638dc6f9e015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13dba6a3-c6d1-4329-8112-638dc6f9e015', 'volume_size': 1} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-978030083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13dba6a3-c6d1-4329-8112-638dc6f9e015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:20Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Creating volume 13dba6a3-c6d1-4329-8112-638dc6f9e015 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:20 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:20 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 1073741824 Sep 28 19:09:20 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:20 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-516989e6-70de-46a0-aa8f-3b23a38ed292" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Lock "cinder-quobyte-516989e6-70de-46a0-aa8f-3b23a38ed292" released by "delete_volume" :: held 1.190s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Created reservations ['4dbea0c9-dbdf-4f79-9fe8-a89639f73a09', 'c4f935d6-8ef1-4543-b8ac-64a989c1acea', 'ef58a463-9ca6-42f8-9992-98a1d90eb685', '66c17668-3272-42e1-a072-4ceda640c189'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:20 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:20 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:20 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.424s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:20 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Deleted volume successfully. Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-68eef134-4600-4778-a6c3-b2dc2cbf5a9c tempest-VolumesActionsTest-408773144 None] Lock "cinder-516989e6-70de-46a0-aa8f-3b23a38ed292-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:21 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 1073741824" returned: 0 in 0.963s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:21 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 Sep 28 19:09:21 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:21 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d8b3d6-28c4-4fda-bad4-346a89eb25d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13dba6a3-c6d1-4329-8112-638dc6f9e015', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5add68-9480-47ef-a7b1-a542ab97fa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:21 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Volume volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 (13dba6a3-c6d1-4329-8112-638dc6f9e015): created successfully Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5add68-9480-47ef-a7b1-a542ab97fa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (97f3bb78-9ab3-43a5-b8a3-d565b9755d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-74931ecc-652c-412f-a152-e7bf56b55c5d tempest-VolumesGetTest-168182217 None] Created volume successfully. Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (acc9818a-ff23-4536-b9de-4e3d5185888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c640e050-c1c6-479a-a7a1-7c2a700f2a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c640e050-c1c6-479a-a7a1-7c2a700f2a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-597975072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce83811-9c50-4052-9368-75c07fcb6f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:22Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985ba959-873b-4197-9da6-9668e32b4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985ba959-873b-4197-9da6-9668e32b4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de19a78-6366-4ea8-b958-46d01bb4b8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de19a78-6366-4ea8-b958-46d01bb4b8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce83811-9c50-4052-9368-75c07fcb6f4b', 'volume_name': 'volume-bce83811-9c50-4052-9368-75c07fcb6f4b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a13f79a-8001-4b00-81ae-c7ebbe0421fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a13f79a-8001-4b00-81ae-c7ebbe0421fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdac778-f7c1-493b-bc7e-cb19a3f02b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:22 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Volume bce83811-9c50-4052-9368-75c07fcb6f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce83811-9c50-4052-9368-75c07fcb6f4b', 'volume_size': 1} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-597975072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce83811-9c50-4052-9368-75c07fcb6f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:22Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Creating volume bce83811-9c50-4052-9368-75c07fcb6f4b {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:22 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:22 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b 1073741824 Sep 28 19:09:22 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:22 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b 1073741824" returned: 0 in 0.743s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:22 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:22 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b Sep 28 19:09:22 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (6cefcac7-a2b7-4c0c-a606-2e302a74a480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64eeeb2-74ef-4b74-9287-d78052c2babd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64eeeb2-74ef-4b74-9287-d78052c2babd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-325818596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4c02c6-8b24-488f-b8bd-ed65031e8ad4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=13dba6a3-c6d1-4329-8112-638dc6f9e015,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:23Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303d879b-079c-49d4-927b-65190aa7854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303d879b-079c-49d4-927b-65190aa7854d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd8842d-6f77-4a81-a414-cdc352483286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd8842d-6f77-4a81-a414-cdc352483286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3e4c02c6-8b24-488f-b8bd-ed65031e8ad4', 'volume_name': 'volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4', 'volume_size': 1, 'source_volid': '13dba6a3-c6d1-4329-8112-638dc6f9e015', 'source_volstatus': 'available'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4599985a-6d7b-49cf-be77-8c92c19ee973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4599985a-6d7b-49cf-be77-8c92c19ee973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca9ca08-3b19-42cf-b9e5-2ee34090b7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Volume 3e4c02c6-8b24-488f-b8bd-ed65031e8ad4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4', 'volume_size': 1, 'source_volid': '13dba6a3-c6d1-4329-8112-638dc6f9e015', 'source_volstatus': 'available'} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:23 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b" returned: 0 in 0.361s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.134s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:23 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Cloning volume 13dba6a3-c6d1-4329-8112-638dc6f9e015 to volume 3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdac778-f7c1-493b-bc7e-cb19a3f02b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce83811-9c50-4052-9368-75c07fcb6f4b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c46b98-7471-4add-9d30-ed01c92be399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Volume volume-bce83811-9c50-4052-9368-75c07fcb6f4b (bce83811-9c50-4052-9368-75c07fcb6f4b): created successfully Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c46b98-7471-4add-9d30-ed01c92be399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (acc9818a-ff23-4536-b9de-4e3d5185888a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Creating offline snapshot e5049d97-872b-4a90-84a1-e7797f222b6b of volume 13dba6a3-c6d1-4329-8112-638dc6f9e015 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:09:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d4add54e-c9ec-4a35-9370-c42c7125c58b tempest-VolumesActionsTest-17280824 None] Created volume successfully. Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5e9dc3-1799-4a93-80db-8b7a944cc488]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:23 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 Sep 28 19:09:23 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:23 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015" returned: 0 in 0.567s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:24 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b 1G Sep 28 19:09:24 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Acquiring lock "cinder-bce83811-9c50-4052-9368-75c07fcb6f4b-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Lock "cinder-bce83811-9c50-4052-9368-75c07fcb6f4b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Acquiring lock "cinder-quobyte-bce83811-9c50-4052-9368-75c07fcb6f4b" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Lock "cinder-quobyte-bce83811-9c50-4052-9368-75c07fcb6f4b" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:24 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b48b5d3-4b75-444d-8b4e-e153027e862e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-0b86ffd9-6dba-4a53-92c7-22e7313dd636 req-229d679a-4184-4b4d-a694-8760429c7e94 tempest-AttachVolumeNegativeTest-969719363 None] Terminate volume connection completed successfully. Sep 28 19:09:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-0b86ffd9-6dba-4a53-92c7-22e7313dd636 req-229d679a-4184-4b4d-a694-8760429c7e94 tempest-AttachVolumeNegativeTest-969719363 None] Deleting attachment b8b1883f-464b-43c2-8ad3-d4e8d06b4b77. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:09:24 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b Sep 28 19:09:24 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:24 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b 1G" returned: 0 in 0.711s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:24 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b Sep 28 19:09:24 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:25 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b" returned: 0 in 0.579s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:25 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b" returned: 0 in 0.465s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:25 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b is being set with open permissions: ugo+rw Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:25 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b Sep 28 19:09:25 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:25 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b Sep 28 19:09:25 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:25 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bce83811-9c50-4052-9368-75c07fcb6f4b" returned: 0 in 0.461s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Lock "cinder-quobyte-bce83811-9c50-4052-9368-75c07fcb6f4b" released by "delete_volume" :: held 1.131s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:25 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b" returned: 0 in 0.476s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:25 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.info Sep 28 19:09:25 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Created reservations ['31d85faa-30a3-4f60-b983-7c2d1014272d', '22745811-3e9a-49c0-95f1-912094fe6b01', 'ae0bf138-d1bd-4231-9c3b-9ada95721c2b', 'e865816a-bc6d-4015-a238-0a82742e64ed'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:25 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:25 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:26 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.info" returned: 0 in 0.427s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:26 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.info is being set with open permissions: ugo+rw Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:26 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.info Sep 28 19:09:26 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:26 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.583s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Deleted volume successfully. Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e0d89fb-cf6a-49fc-bb9f-742054013a1b tempest-VolumesActionsTest-408773144 None] Lock "cinder-bce83811-9c50-4052-9368-75c07fcb6f4b-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:26 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.info" returned: 0 in 0.523s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-quobyte-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] snapshot: e5049d97-872b-4a90-84a1-e7797f222b6b, volume: 3e4c02c6-8b24-488f-b8bd-ed65031e8ad4, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[17af2808-f6c8-4ab7-b09b-af2e2e84b80d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:27 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b Sep 28 19:09:27 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:27 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b" returned: 0 in 0.860s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13dba6a3-c6d1-4329-8112-638dc6f9e015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7feac7d-ad30-4d29-9d0e-83386456997c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:27 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 Sep 28 19:09:27 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (69ed0ac1-b18b-429e-8ff7-a54007bc8add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d22bf4-1bfe-411f-a3bd-bd7b7edc039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d22bf4-1bfe-411f-a3bd-bd7b7edc039c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1997115497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca9949a-3e47-40c2-b837-673beb2bf9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:28Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc31b788-b459-4639-8727-1aa2d9cdad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc31b788-b459-4639-8727-1aa2d9cdad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46cc394e-85c0-4c3b-b09a-0dc133220f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46cc394e-85c0-4c3b-b09a-0dc133220f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ca9949a-3e47-40c2-b837-673beb2bf9d8', 'volume_name': 'volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c720121-4b77-46ea-a04d-3a5e1818149b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c720121-4b77-46ea-a04d-3a5e1818149b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97389f5b-d394-4902-b3f9-e1ea6ee2c5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Volume 4ca9949a-3e47-40c2-b837-673beb2bf9d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8', 'volume_size': 1} Sep 28 19:09:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:28 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015" returned: 0 in 0.473s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:09:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:09:28 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:09:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:28 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 Sep 28 19:09:28 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:09:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:34 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:34 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:35 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.787s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:09:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:09:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:09:37 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4" returned: 0 in 9.400s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:37 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015, size 1024.00 MB, duration 9.40 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:09:37 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Converted 1024.00 MB image at 108.92 MB/s Sep 28 19:09:37 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 is being set with open permissions: ugo+rw Sep 28 19:09:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:37 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 Sep 28 19:09:37 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:37 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=113,cinder:SELECT=89,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:09:37 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=86,cinder:UPDATE=116,cinder:INSERT=24,cinder:DELETE=9 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:09:37 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4" returned: 0 in 0.354s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4" released by "_copy_volume_from_snapshot" :: held 11.254s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-quobyte-e5049d97-872b-4a90-84a1-e7797f222b6b" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-e5049d97-872b-4a90-84a1-e7797f222b6b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Deleting offline snapshot e5049d97-872b-4a90-84a1-e7797f222b6b of volume 13dba6a3-c6d1-4329-8112-638dc6f9e015 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] snapshot_file for this snap is: volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6726b6-a71b-4fb2-95c9-dd24490ab94e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:38 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b Sep 28 19:09:38 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Flow 'volume_create_manager' (e44dba0a-7957-4de5-9ba9-2a127e0be739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a1c29b-be28-42d4-86ad-322d5db9439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a1c29b-be28-42d4-86ad-322d5db9439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e30b1b6-c9a6-4b3b-834e-61597346646d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ea5cb92eb461c96c76f94c9e6387f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:38Z,use_quota=True,user_id='b1bb8fd7bef64814a8432fbad4d9c95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e36c0f79-d4ef-4501-a4a5-341387207471),volume_type_id=e36c0f79-d4ef-4501-a4a5-341387207471)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1b9713-1a67-4a3a-87c4-2ca3d6ac22f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1b9713-1a67-4a3a-87c4-2ca3d6ac22f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04706953-c91b-4d3d-8110-48e171e2f186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 19:09:38 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b" returned: 0 in 0.508s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13dba6a3-c6d1-4329-8112-638dc6f9e015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[03318ab0-ee47-4683-b92f-85ff028282ce]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04706953-c91b-4d3d-8110-48e171e2f186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e30b1b6-c9a6-4b3b-834e-61597346646d', 'volume_name': 'volume-8e30b1b6-c9a6-4b3b-834e-61597346646d', 'volume_size': 1, 'image_id': '8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '045310ebc640726bbe4dece5d33ec676', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e0ea5cb92eb461c96c76f94c9e6387f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8935c3388bb29333d19e5da65dd9d045531ae82b245e9f5fbe7c211043fcdc22223b01bee19fef483a40ba666235f30bfc87760aca0f35822e251178d099929e', 'id': '8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'created_at': datetime.datetime(2026, 9, 28, 17, 9, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 9, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64117cc-7fe8-498d-8416-49a23c3a4abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64117cc-7fe8-498d-8416-49a23c3a4abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b0e45f-284e-4421-8cfd-6a8a435ac0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Volume 8e30b1b6-c9a6-4b3b-834e-61597346646d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e30b1b6-c9a6-4b3b-834e-61597346646d', 'volume_size': 1, 'image_id': '8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '045310ebc640726bbe4dece5d33ec676', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e0ea5cb92eb461c96c76f94c9e6387f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8935c3388bb29333d19e5da65dd9d045531ae82b245e9f5fbe7c211043fcdc22223b01bee19fef483a40ba666235f30bfc87760aca0f35822e251178d099929e', 'id': '8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'created_at': datetime.datetime(2026, 9, 28, 17, 9, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 9, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Trying to clone 8e30b1b6-c9a6-4b3b-834e-61597346646d from image 8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 19:09:38 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 Sep 28 19:09:38 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 19:09:38 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Image download 0.00 MB at 0.00 MB/s Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5425b86-a5f2-4f3d-88cd-c60637e20be5]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:39 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD Sep 28 19:09:39 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:39 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015" returned: 0 in 0.668s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:39 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b Sep 28 19:09:39 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:39 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:39 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD Sep 28 19:09:39 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:39 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b" returned: 0 in 0.458s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:39 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Temporary image 8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6 is fetched for user b1bb8fd7bef64814a8432fbad4d9c95b. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 19:09:39 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b Sep 28 19:09:39 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a49c44-a4fc-42c8-b2a0-eacb9bbba2dd]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:40 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD Sep 28 19:09:40 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:40 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015.e5049d97-872b-4a90-84a1-e7797f222b6b" returned: 0 in 0.357s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-e5049d97-872b-4a90-84a1-e7797f222b6b" released by "_delete_snapshot" :: held 2.165s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.925s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.269s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1997115497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca9949a-3e47-40c2-b837-673beb2bf9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e0845564140c2b0dfaed25c1d3e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:28Z,use_quota=True,user_id='5ff466ec23bd4c06bf0569761e83ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Creating volume 4ca9949a-3e47-40c2-b837-673beb2bf9d8 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:40 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:40 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8 1073741824 Sep 28 19:09:40 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca9ca08-3b19-42cf-b9e5-2ee34090b7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4', 'volume_size': 1, 'source_volid': '13dba6a3-c6d1-4329-8112-638dc6f9e015', 'source_volstatus': 'available'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9bbddc-194b-44a4-ad00-d94df51b246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:40 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Volume volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 (3e4c02c6-8b24-488f-b8bd-ed65031e8ad4): created successfully Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9bbddc-194b-44a4-ad00-d94df51b246e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (6cefcac7-a2b7-4c0c-a606-2e302a74a480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:40 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-956a5d9b-55cb-4024-ac22-5fcb58e6ee68 tempest-VolumesGetTest-168182217 None] Created volume successfully. Sep 28 19:09:40 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD Sep 28 19:09:40 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:40 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:40 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8 1073741824" returned: 0 in 0.607s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:40 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8 Sep 28 19:09:40 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:41 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8" returned: 0 in 0.483s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e30b1b6-c9a6-4b3b-834e-61597346646d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ea5cb92eb461c96c76f94c9e6387f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:38Z,use_quota=True,user_id='b1bb8fd7bef64814a8432fbad4d9c95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e36c0f79-d4ef-4501-a4a5-341387207471),volume_type_id=e36c0f79-d4ef-4501-a4a5-341387207471)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Creating volume 8e30b1b6-c9a6-4b3b-834e-61597346646d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:41 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97389f5b-d394-4902-b3f9-e1ea6ee2c5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:41 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d 1073741824 Sep 28 19:09:41 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ee6d76-8155-4798-b20b-6a4b0f592d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Volume volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8 (4ca9949a-3e47-40c2-b837-673beb2bf9d8): created successfully Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ee6d76-8155-4798-b20b-6a4b0f592d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Flow 'volume_create_manager' (69ed0ac1-b18b-429e-8ff7-a54007bc8add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a46a56dc-c9e7-42b7-a1bf-0682cec08329 tempest-VolumesActionsTest-17280824 None] Created volume successfully. Sep 28 19:09:42 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d 1073741824" returned: 0 in 0.750s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (7097799c-d526-4a79-bcac-a9892e894693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a353fe6b-85d9-4c09-807b-8c729600ddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a353fe6b-85d9-4c09-807b-8c729600ddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-998333137',display_name='tempest-VolumesGetTest-Volume-1952365880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f766b0-eb71-4fec-8209-224ec608bce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:42Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09aa52e-e42e-4e01-b8fa-feb7f20f9ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09aa52e-e42e-4e01-b8fa-feb7f20f9ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ea3e5b-8bc8-4c42-ab44-f1f46f443a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ea3e5b-8bc8-4c42-ab44-f1f46f443a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f766b0-eb71-4fec-8209-224ec608bce2', 'volume_name': 'volume-d8f766b0-eb71-4fec-8209-224ec608bce2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1e82ef-8343-4691-ac91-f7d76391598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1e82ef-8343-4691-ac91-f7d76391598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f619ee61-5284-4b4a-a0d7-89158de466c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Volume d8f766b0-eb71-4fec-8209-224ec608bce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f766b0-eb71-4fec-8209-224ec608bce2', 'volume_size': 1} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:42 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d Sep 28 19:09:42 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:42 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-998333137',display_name='tempest-VolumesGetTest-Volume-1952365880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f766b0-eb71-4fec-8209-224ec608bce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:42Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Creating volume d8f766b0-eb71-4fec-8209-224ec608bce2 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:42 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:42 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2 1073741824 Sep 28 19:09:42 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Attempting download of 8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'metadata': {}}])) to volume 8e30b1b6-c9a6-4b3b-834e-61597346646d. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e69cf1e-0bd8-4a3f-829e-212354f85db5]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_m91e5b7z {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:43 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_m91e5b7z Sep 28 19:09:43 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Acquiring lock "cinder-4ca9949a-3e47-40c2-b837-673beb2bf9d8-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Lock "cinder-4ca9949a-3e47-40c2-b837-673beb2bf9d8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Acquiring lock "cinder-quobyte-4ca9949a-3e47-40c2-b837-673beb2bf9d8" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:43 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Lock "cinder-quobyte-4ca9949a-3e47-40c2-b837-673beb2bf9d8" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_m91e5b7z" returned: 0 in 0.429s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_m91e5b7z {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad87531-1787-46ea-92ea-b443ba76d17a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:43 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_m91e5b7z Sep 28 19:09:43 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:43 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8 Sep 28 19:09:43 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:43 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2 1073741824" returned: 0 in 0.737s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:43 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2 Sep 28 19:09:43 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:43 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_m91e5b7z" returned: 1 in 0.508s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_m91e5b7z' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c319a9-ad65-48a4-868a-a23d936301dc]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:43 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f619ee61-5284-4b4a-a0d7-89158de466c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f766b0-eb71-4fec-8209-224ec608bce2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a436e24-1325-4547-be81-90ed77925ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Volume volume-d8f766b0-eb71-4fec-8209-224ec608bce2 (d8f766b0-eb71-4fec-8209-224ec608bce2): created successfully Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a436e24-1325-4547-be81-90ed77925ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (7097799c-d526-4a79-bcac-a9892e894693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0ca0d05e-3d86-4d04-b05b-896b06821179 tempest-VolumesGetTest-168182217 None] Created volume successfully. Sep 28 19:09:44 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8" returned: 0 in 0.657s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:44 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD Sep 28 19:09:44 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:44 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8 Sep 28 19:09:44 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:44 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4ca9949a-3e47-40c2-b837-673beb2bf9d8" returned: 0 in 0.388s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:44 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Lock "cinder-quobyte-4ca9949a-3e47-40c2-b837-673beb2bf9d8" released by "delete_volume" :: held 1.112s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD" returned: 0 in 0.591s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-d8f766b0-eb71-4fec-8209-224ec608bce2-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Lock "cinder-d8f766b0-eb71-4fec-8209-224ec608bce2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-quobyte-d8f766b0-eb71-4fec-8209-224ec608bce2" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Created reservations ['7894eb37-3cfd-4bd9-a348-e1201f54717f', '71cd80aa-32fc-4d90-81cb-558e83b58898', '992c1830-201a-4b59-9aa7-94cc9019cd84', '46f660d3-03f2-410b-be1d-b562c993f8b0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-d8f766b0-eb71-4fec-8209-224ec608bce2" acquired by "delete_volume" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:44 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD Sep 28 19:09:44 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b040a0-6470-4c74-b31e-dfab51c44624]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:44 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:44 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:44 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2 Sep 28 19:09:44 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:45 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD" returned: 1 in 0.617s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:09:45 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] 8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6 was raw, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 19:09:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:45 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.391s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:45 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:45 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d Sep 28 19:09:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Deleted volume successfully. Sep 28 19:09:45 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee653a01-4402-4f7f-b731-aa02f7488b66 tempest-VolumesActionsTest-17280824 None] Lock "cinder-4ca9949a-3e47-40c2-b837-673beb2bf9d8-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:45 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2" returned: 0 in 0.825s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:45 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2 Sep 28 19:09:45 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:46 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d8f766b0-eb71-4fec-8209-224ec608bce2" returned: 0 in 0.594s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-d8f766b0-eb71-4fec-8209-224ec608bce2" released by "delete_volume" :: held 1.491s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Created reservations ['b3deec8b-c87a-4deb-91c6-472beecf54ef', '76a0c37a-c041-409d-9605-a15d1186b983', '17dcecef-909a-4c44-9d56-ed2afaa9efca', 'ddb218f2-0605-4aca-867b-774303dd70db'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:46 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d" returned: 0 in 1.159s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6_sf8a_q3rdevstack@QuobyteHD, size 0.00 MB, duration 1.16 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:09:46 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:46 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d 1G Sep 28 19:09:46 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:46 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:46 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:46 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d 1G" returned: 0 in 0.567s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Downloaded image 8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'metadata': {}}])) to volume 8e30b1b6-c9a6-4b3b-834e-61597346646d successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Temporary image 8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6 for user b1bb8fd7bef64814a8432fbad4d9c95b is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Marking volume 8e30b1b6-c9a6-4b3b-834e-61597346646d as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Copying metadata from image 8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6 to 8e30b1b6-c9a6-4b3b-834e-61597346646d. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 19:09:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Creating volume glance metadata for volume 8e30b1b6-c9a6-4b3b-834e-61597346646d backed by image 8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '045310ebc640726bbe4dece5d33ec676', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 19:09:47 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.625s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Deleted volume successfully. Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-efe18eb4-e918-40bf-9153-1a590d4f0859 tempest-VolumesGetTest-168182217 None] Lock "cinder-d8f766b0-eb71-4fec-8209-224ec608bce2-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b0e45f-284e-4421-8cfd-6a8a435ac0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e30b1b6-c9a6-4b3b-834e-61597346646d', 'volume_size': 1, 'image_id': '8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '045310ebc640726bbe4dece5d33ec676', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e0ea5cb92eb461c96c76f94c9e6387f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8935c3388bb29333d19e5da65dd9d045531ae82b245e9f5fbe7c211043fcdc22223b01bee19fef483a40ba666235f30bfc87760aca0f35822e251178d099929e', 'id': '8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6', 'created_at': datetime.datetime(2026, 9, 28, 17, 9, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 9, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e0f5b16-8ae8-4d7f-b8ee-c8d46e346df6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8129bb4b-62a7-46f8-8229-152ba3f6e4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Lock "cinder-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Volume volume-8e30b1b6-c9a6-4b3b-834e-61597346646d (8e30b1b6-c9a6-4b3b-834e-61597346646d): created successfully Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8129bb4b-62a7-46f8-8229-152ba3f6e4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Flow 'volume_create_manager' (e44dba0a-7957-4de5-9ba9-2a127e0be739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e3d411c5-6073-4a64-ab0b-b928005d95b7 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Created volume successfully. Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-quobyte-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4" acquired by "delete_volume" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[768840c3-bf35-41f2-9057-f11b8b572865]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:47 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 Sep 28 19:09:47 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:47 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:47 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4 Sep 28 19:09:47 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:48 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4" released by "delete_volume" :: held 0.857s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Created reservations ['f80a6d50-14e9-4d79-ac50-5c76f09913d1', 'f8725368-78b6-428c-b282-900fa3c543ea', '7dd38d16-b9dc-4f48-a13a-1cfceaee9dc5', 'e90dedbc-293d-48ca-adc9-07fb8e54d5ef'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Acquiring lock "cinder-8e30b1b6-c9a6-4b3b-834e-61597346646d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Lock "cinder-8e30b1b6-c9a6-4b3b-834e-61597346646d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Acquiring lock "cinder-quobyte-8e30b1b6-c9a6-4b3b-834e-61597346646d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:48 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:48 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Lock "cinder-quobyte-8e30b1b6-c9a6-4b3b-834e-61597346646d" acquired by "delete_volume" :: waited 0.154s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59c7307-f2b3-4c6e-98f8-ae7d24155b09]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:49 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d Sep 28 19:09:49 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:49 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.628s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Deleted volume successfully. Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-485fa458-e89c-4717-a299-b5ace190fa4c tempest-VolumesGetTest-168182217 None] Lock "cinder-3e4c02c6-8b24-488f-b8bd-ed65031e8ad4-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-13dba6a3-c6d1-4329-8112-638dc6f9e015-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Lock "cinder-13dba6a3-c6d1-4329-8112-638dc6f9e015-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:49 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d" returned: 0 in 0.897s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-quobyte-13dba6a3-c6d1-4329-8112-638dc6f9e015" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:09:49 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d Sep 28 19:09:49 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-13dba6a3-c6d1-4329-8112-638dc6f9e015" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d319727-ce5d-412b-9112-d8b5ee1ac73f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:50 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 Sep 28 19:09:50 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:50 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e30b1b6-c9a6-4b3b-834e-61597346646d" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Lock "cinder-quobyte-8e30b1b6-c9a6-4b3b-834e-61597346646d" released by "delete_volume" :: held 1.388s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:50 devstack cinder-volume[86846]: WARNING cinder.quota [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:09:50 devstack cinder-volume[86846]: WARNING cinder.quota [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Created reservations ['74b881dc-9ab7-4620-a128-940e3d1dcdfb', 'a4f418a0-b562-414d-b778-f02f1584ab09', 'b419f839-1643-4e1b-a9f3-554eda04f3c2', 'a9285453-5b78-434c-bb66-11a9fbaf35f6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:50 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015" returned: 0 in 0.573s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:50 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:50 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:50 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015 Sep 28 19:09:50 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:51 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.529s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Deleted volume successfully. Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dc1df2a0-1c13-4e65-adea-1d6d3d75d8b9 tempest-VolumeAndVolumeTypeFromImageTest-706413685 None] Lock "cinder-8e30b1b6-c9a6-4b3b-834e-61597346646d-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:51 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-13dba6a3-c6d1-4329-8112-638dc6f9e015" returned: 0 in 0.663s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-13dba6a3-c6d1-4329-8112-638dc6f9e015" released by "delete_volume" :: held 1.371s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Created reservations ['1fe85995-14ca-4b05-adb9-3937d7cc4028', 'fc9fb9bf-b101-486a-b25e-69d2b0ba92b6', '54fd1e18-0375-4df9-af68-168d58146071', '8e73ff02-90f0-4787-9b0e-21a3aa9c0ff4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:51 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:09:51 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:51 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.388s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:09:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Deleted volume successfully. Sep 28 19:09:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a1ff9c0-6fad-4876-8dae-43a2bde76853 tempest-VolumesGetTest-168182217 None] Lock "cinder-13dba6a3-c6d1-4329-8112-638dc6f9e015-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:09:53 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:09:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (d9620784-34cd-478b-8a9c-b2714bae263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:09:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637dacc0-09e8-4a22-b28a-ea9855db984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637dacc0-09e8-4a22-b28a-ea9855db984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1304434797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e454587f-7a03-4b6f-a118-978f74a5dd4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:54Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0190285e-3691-4427-afd8-ddfa3a8e3cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0190285e-3691-4427-afd8-ddfa3a8e3cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0d5d28-8757-4230-a18b-81a6370f690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:53 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 19:09:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0d5d28-8757-4230-a18b-81a6370f690f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e454587f-7a03-4b6f-a118-978f74a5dd4e', 'volume_name': 'volume-e454587f-7a03-4b6f-a118-978f74a5dd4e', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95bb407-30bd-4d2a-8851-d9bf170df292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95bb407-30bd-4d2a-8851-d9bf170df292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:09:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb979eb-842f-4bbc-a65d-73c6b9f3c52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:09:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Volume e454587f-7a03-4b6f-a118-978f74a5dd4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e454587f-7a03-4b6f-a118-978f74a5dd4e', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 19:09:54 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Trying to clone e454587f-7a03-4b6f-a118-978f74a5dd4e from image 62ee51ad-b6ed-458d-a726-fccffd745d46 at location (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 19:09:55 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 19:09:55 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Image download 20.69 MB at 20.69 MB/s Sep 28 19:09:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0593f1fe-9847-4db9-bea8-ae6de257abc0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:55 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD Sep 28 19:09:55 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:56 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD" returned: 0 in 0.691s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:56 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Temporary image 62ee51ad-b6ed-458d-a726-fccffd745d46 is fetched for user 4e08f1a57f234a73ab9f24964e8a06d9. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 19:09:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d288c8-f633-4bb5-99f3-8c7133069dee]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:56 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD Sep 28 19:09:56 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:57 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD" returned: 0 in 0.865s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1304434797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e454587f-7a03-4b6f-a118-978f74a5dd4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:09:54Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Creating volume e454587f-7a03-4b6f-a118-978f74a5dd4e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:09:57 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:09:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:57 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e 1073741824 Sep 28 19:09:57 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:58 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e 1073741824" returned: 0 in 0.788s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:58 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e Sep 28 19:09:58 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:58 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e" returned: 0 in 0.441s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:09:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:09:58 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Attempting download of 62ee51ad-b6ed-458d-a726-fccffd745d46 ((None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}])) to volume e454587f-7a03-4b6f-a118-978f74a5dd4e. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 19:09:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6538f7-a0b6-43e6-947a-749697a89123]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_y3ur9gdj {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:59 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_y3ur9gdj Sep 28 19:09:59 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:59 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_y3ur9gdj" returned: 0 in 0.510s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_y3ur9gdj {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:09:59 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_y3ur9gdj Sep 28 19:09:59 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:09:59 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 28 19:09:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_y3ur9gdj" returned: 1 in 0.520s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:09:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_y3ur9gdj' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:09:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82491b0-4b56-418d-ae26-4e3b9df5de11]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:09:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:00 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD Sep 28 19:10:00 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:00 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD" returned: 0 in 0.551s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] 62ee51ad-b6ed-458d-a726-fccffd745d46 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:00 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e Sep 28 19:10:00 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (a30ac602-60fa-4745-8a94-d78280db4a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03ce5f4-b83b-4b2d-aaf1-012e612324c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03ce5f4-b83b-4b2d-aaf1-012e612324c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203071873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babc48ae-08c8-4147-89e2-abff499b24d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:01Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f71893-8f52-4b47-9116-774eb0323c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f71893-8f52-4b47-9116-774eb0323c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d23655-9e8e-400f-be72-8a9735e6601a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d23655-9e8e-400f-be72-8a9735e6601a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babc48ae-08c8-4147-89e2-abff499b24d6', 'volume_name': 'volume-babc48ae-08c8-4147-89e2-abff499b24d6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5197b6e0-090e-43d7-b3d8-883e6c9a764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5197b6e0-090e-43d7-b3d8-883e6c9a764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff23b0ad-2709-4a59-840c-c1bc41c627b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume babc48ae-08c8-4147-89e2-abff499b24d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babc48ae-08c8-4147-89e2-abff499b24d6', 'volume_size': 1} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203071873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babc48ae-08c8-4147-89e2-abff499b24d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:01Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Creating volume babc48ae-08c8-4147-89e2-abff499b24d6 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:00 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:00 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 1073741824 Sep 28 19:10:00 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:01 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 1073741824" returned: 0 in 0.686s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:01 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 Sep 28 19:10:01 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:02 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6" returned: 0 in 0.498s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff23b0ad-2709-4a59-840c-c1bc41c627b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babc48ae-08c8-4147-89e2-abff499b24d6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d388589-74c6-4a60-8a1c-2bc60b012089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume volume-babc48ae-08c8-4147-89e2-abff499b24d6 (babc48ae-08c8-4147-89e2-abff499b24d6): created successfully Sep 28 19:10:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d388589-74c6-4a60-8a1c-2bc60b012089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (a30ac602-60fa-4745-8a94-d78280db4a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-27f55f23-62e6-417c-8353-908181b4f007 tempest-CreateVolumesFromSnapshotTest-714597120 None] Created volume successfully. Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Creating offline snapshot 3c11cb6c-31d5-4a2e-a061-11452c7fdc8e of volume babc48ae-08c8-4147-89e2-abff499b24d6 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef881fda-ab9f-45ab-8381-43684ad1ddee]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:03 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e" returned: 0 in 2.881s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_mmymi7q1devstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:10:03 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Converted 112.00 MB image at 38.86 MB/s Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:03 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e 1G Sep 28 19:10:03 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:03 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 Sep 28 19:10:03 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:03 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e 1G" returned: 0 in 0.407s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Downloaded image 62ee51ad-b6ed-458d-a726-fccffd745d46 ((None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}])) to volume e454587f-7a03-4b6f-a118-978f74a5dd4e successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Temporary image 62ee51ad-b6ed-458d-a726-fccffd745d46 for user 4e08f1a57f234a73ab9f24964e8a06d9 is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Marking volume e454587f-7a03-4b6f-a118-978f74a5dd4e as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Copying metadata from image 62ee51ad-b6ed-458d-a726-fccffd745d46 to e454587f-7a03-4b6f-a118-978f74a5dd4e. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Creating volume glance metadata for volume e454587f-7a03-4b6f-a118-978f74a5dd4e backed by image 62ee51ad-b6ed-458d-a726-fccffd745d46 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 19:10:03 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6" returned: 0 in 0.509s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:03 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e 1G Sep 28 19:10:03 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb979eb-842f-4bbc-a65d-73c6b9f3c52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e454587f-7a03-4b6f-a118-978f74a5dd4e', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8034c3-85ce-463c-bb06-491ab0d22a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:03 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Volume volume-e454587f-7a03-4b6f-a118-978f74a5dd4e (e454587f-7a03-4b6f-a118-978f74a5dd4e): created successfully Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8034c3-85ce-463c-bb06-491ab0d22a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (d9620784-34cd-478b-8a9c-b2714bae263b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-aa655b52-545e-4af0-b4a9-65919b28e52c tempest-VolumesGetTest-168182217 None] Created volume successfully. Sep 28 19:10:04 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e 1G" returned: 0 in 0.591s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-babc48ae-08c8-4147-89e2-abff499b24d6 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:04 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-babc48ae-08c8-4147-89e2-abff499b24d6 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e Sep 28 19:10:04 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:04 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-babc48ae-08c8-4147-89e2-abff499b24d6 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:04 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e is being set with open permissions: ugo+rw Sep 28 19:10:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:04 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e Sep 28 19:10:04 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:05 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e" returned: 0 in 0.303s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:05 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.info Sep 28 19:10:05 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:05 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.info" returned: 0 in 0.310s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:05 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.info is being set with open permissions: ugo+rw Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:05 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.info Sep 28 19:10:05 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:05 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.info" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.567s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4e5d8279-fc61-4aee-a26f-967d965d8720 tempest-CreateVolumesFromSnapshotTest-714597120 None] Create snapshot completed successfully Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (610103dd-4bfb-40a8-a2ef-087480f2b82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046a5076-42a5-4570-b743-86857e66e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046a5076-42a5-4570-b743-86857e66e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1417681708',display_name='tempest-VolumesGetTest-Volume-1590404024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974c437d-0156-49b5-af76-b424e532f37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:06Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a859705-7af5-4a53-972b-15872f94dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a859705-7af5-4a53-972b-15872f94dce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d25049-d915-4c85-9392-03d5db35abd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d25049-d915-4c85-9392-03d5db35abd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974c437d-0156-49b5-af76-b424e532f37b', 'volume_name': 'volume-974c437d-0156-49b5-af76-b424e532f37b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333cca60-5056-4400-aac7-692da5d30f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333cca60-5056-4400-aac7-692da5d30f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61d70c4-ae31-4a30-95e3-a36ee28f6aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Volume 974c437d-0156-49b5-af76-b424e532f37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974c437d-0156-49b5-af76-b424e532f37b', 'volume_size': 1} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1417681708',display_name='tempest-VolumesGetTest-Volume-1590404024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974c437d-0156-49b5-af76-b424e532f37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1019bff44ca74e479f76ebd96f4bfa19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:06Z,use_quota=True,user_id='4e08f1a57f234a73ab9f24964e8a06d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Creating volume 974c437d-0156-49b5-af76-b424e532f37b {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:06 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:06 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b 1073741824 Sep 28 19:10:06 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:06 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b 1073741824" returned: 0 in 0.578s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:06 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b Sep 28 19:10:06 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:07 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b" returned: 0 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61d70c4-ae31-4a30-95e3-a36ee28f6aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974c437d-0156-49b5-af76-b424e532f37b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99a727e-2aea-4b82-b35b-8e77bb489aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (c4a0a2cf-261b-4fc8-b303-270c0f6d0f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debaf9da-5db2-4db6-a3e5-c5813fff541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Volume volume-974c437d-0156-49b5-af76-b424e532f37b (974c437d-0156-49b5-af76-b424e532f37b): created successfully Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99a727e-2aea-4b82-b35b-8e77bb489aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Flow 'volume_create_manager' (610103dd-4bfb-40a8-a2ef-087480f2b82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debaf9da-5db2-4db6-a3e5-c5813fff541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096542660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4eea6c9-06f5-4347-8df1-50a953b6ac0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:07Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3295c743-0a2b-45f2-b447-4c36b814c16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3295c743-0a2b-45f2-b447-4c36b814c16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283916b8-6ec5-41bc-a1cb-f35cbbcbadc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283916b8-6ec5-41bc-a1cb-f35cbbcbadc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4eea6c9-06f5-4347-8df1-50a953b6ac0d', 'volume_name': 'volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404acd13-396e-4566-9a4b-2a0456eb0f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404acd13-396e-4566-9a4b-2a0456eb0f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fc4316-f004-4ab4-ba85-4ac2399e1f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume b4eea6c9-06f5-4347-8df1-50a953b6ac0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d', 'volume_size': 1} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096542660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4eea6c9-06f5-4347-8df1-50a953b6ac0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:07Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Creating volume b4eea6c9-06f5-4347-8df1-50a953b6ac0d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:07 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8e5cac11-3202-498d-9e20-24ffa3eb14fe tempest-VolumesGetTest-168182217 None] Created volume successfully. Sep 28 19:10:07 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d 1073741824 Sep 28 19:10:07 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (275c977a-f6b7-4a28-94d6-a1a26096801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d999b5-9af3-400a-a23e-7dfb76a59f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d999b5-9af3-400a-a23e-7dfb76a59f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-448259191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b3b702-909e-453c-966e-47eb3831fc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:08Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fda5a3-0654-4e35-9f20-ad66566c1411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fda5a3-0654-4e35-9f20-ad66566c1411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ae3b15-3320-4b71-bb3a-1415e29fd8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ae3b15-3320-4b71-bb3a-1415e29fd8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b3b702-909e-453c-966e-47eb3831fc16', 'volume_name': 'volume-60b3b702-909e-453c-966e-47eb3831fc16', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426f9587-eadf-4e2c-9e7f-d65abd35a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426f9587-eadf-4e2c-9e7f-d65abd35a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6da7453-2ad9-440e-9d06-9eedd2894ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume 60b3b702-909e-453c-966e-47eb3831fc16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b3b702-909e-453c-966e-47eb3831fc16', 'volume_size': 1} Sep 28 19:10:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-974c437d-0156-49b5-af76-b424e532f37b-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Lock "cinder-974c437d-0156-49b5-af76-b424e532f37b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:08 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d 1073741824" returned: 0 in 1.185s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-quobyte-974c437d-0156-49b5-af76-b424e532f37b" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-974c437d-0156-49b5-af76-b424e532f37b" acquired by "delete_volume" :: waited 0.074s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:08 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d Sep 28 19:10:08 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a62dd-9a9a-4df7-8111-18a09ce44fc0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (79195326-8627-4f9d-a6b8-893c301683e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4f622d-9881-43ac-9c47-e6d92e5d98ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4f622d-9881-43ac-9c47-e6d92e5d98ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753162421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a17ba53-726c-4dad-bad5-1f3a64aa6cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:09Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07bbf9c-2b09-43db-8bef-a40e45530f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07bbf9c-2b09-43db-8bef-a40e45530f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e39349a-2a50-44cd-b8bd-cad23a337ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e39349a-2a50-44cd-b8bd-cad23a337ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a17ba53-726c-4dad-bad5-1f3a64aa6cad', 'volume_name': 'volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b225c08-b812-4547-b19c-404acd056980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b225c08-b812-4547-b19c-404acd056980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414f8945-d88a-4473-959b-ccddfd052756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume 9a17ba53-726c-4dad-bad5-1f3a64aa6cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad', 'volume_size': 1} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:09 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b Sep 28 19:10:09 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:09 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d" returned: 0 in 0.742s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-448259191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b3b702-909e-453c-966e-47eb3831fc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:08Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Creating volume 60b3b702-909e-453c-966e-47eb3831fc16 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:09 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fc4316-f004-4ab4-ba85-4ac2399e1f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:09 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16 1073741824 Sep 28 19:10:09 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cf1abd-2fbd-46e1-bb5c-ac80133e8e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d (b4eea6c9-06f5-4347-8df1-50a953b6ac0d): created successfully Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cf1abd-2fbd-46e1-bb5c-ac80133e8e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (c4a0a2cf-261b-4fc8-b303-270c0f6d0f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f2ac3a5a-b3ee-405b-bb0d-873b37e46b9a tempest-CreateVolumesFromSnapshotTest-714597120 None] Created volume successfully. Sep 28 19:10:09 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b" returned: 0 in 0.840s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:09 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b Sep 28 19:10:09 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (e856c978-1776-40dc-9834-ed52eda17f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bd8c90-5039-4667-9c4b-8856fb000b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bd8c90-5039-4667-9c4b-8856fb000b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1447415443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd933bde-ac8d-4961-9476-05a6b9654211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:10Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2837f8d2-73ca-4e0f-b58c-d9cd4a1696f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2837f8d2-73ca-4e0f-b58c-d9cd4a1696f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e295faf4-d282-48fe-a84a-058aa9fae876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e295faf4-d282-48fe-a84a-058aa9fae876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd933bde-ac8d-4961-9476-05a6b9654211', 'volume_name': 'volume-dd933bde-ac8d-4961-9476-05a6b9654211', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66071a2f-b3cf-476d-a771-0b8efc943c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66071a2f-b3cf-476d-a771-0b8efc943c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f851b8b-fa43-4c05-8c46-8a5f10c2dc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume dd933bde-ac8d-4961-9476-05a6b9654211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd933bde-ac8d-4961-9476-05a6b9654211', 'volume_size': 1} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:10 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-974c437d-0156-49b5-af76-b424e532f37b" returned: 0 in 0.640s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-974c437d-0156-49b5-af76-b424e532f37b" released by "delete_volume" :: held 1.611s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:10 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16 1073741824" returned: 0 in 0.960s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Created reservations ['9e0ea4ad-5430-4874-9fb0-c85d70b1987c', '4d0255e9-1e1f-41d0-9090-5fb2e25acf90', '68d900a5-295f-4e6d-b7d4-5682d23e1734', '99096bf3-502c-4b46-9200-a524ac558238'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (6a69039f-bd16-4947-b9d6-859f00f98a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d381d2e4-65f8-4ca8-82af-cdc5d62bd7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:10 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16 Sep 28 19:10:10 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d381d2e4-65f8-4ca8-82af-cdc5d62bd7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-222945407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec807ccc-714e-409f-913a-c0dbf2580a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:11Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ccdb26-a70e-437e-92b1-f2d28ab3c94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ccdb26-a70e-437e-92b1-f2d28ab3c94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a843ca8-4700-47ed-bef5-3ee8f904813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a843ca8-4700-47ed-bef5-3ee8f904813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec807ccc-714e-409f-913a-c0dbf2580a30', 'volume_name': 'volume-ec807ccc-714e-409f-913a-c0dbf2580a30', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98476d5e-9204-407a-bc02-0b543c19eee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98476d5e-9204-407a-bc02-0b543c19eee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2210e9-2fc1-4d2d-9778-c43612ada0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume ec807ccc-714e-409f-913a-c0dbf2580a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec807ccc-714e-409f-913a-c0dbf2580a30', 'volume_size': 1} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:10 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:10 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:10 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.833s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753162421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a17ba53-726c-4dad-bad5-1f3a64aa6cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:09Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Creating volume 9a17ba53-726c-4dad-bad5-1f3a64aa6cad {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:10 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6da7453-2ad9-440e-9d06-9eedd2894ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b3b702-909e-453c-966e-47eb3831fc16', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac4ef9e-c7e6-46e9-8f20-39836c54c986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:11 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad 1073741824 Sep 28 19:10:11 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume volume-60b3b702-909e-453c-966e-47eb3831fc16 (60b3b702-909e-453c-966e-47eb3831fc16): created successfully Sep 28 19:10:11 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac4ef9e-c7e6-46e9-8f20-39836c54c986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (275c977a-f6b7-4a28-94d6-a1a26096801a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-e454587f-7a03-4b6f-a118-978f74a5dd4e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.387s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Deleted volume successfully. Sep 28 19:10:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-58945031-49ba-40a7-97a1-dd0e60f0735e tempest-CreateVolumesFromSnapshotTest-714597120 None] Created volume successfully. Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Lock "cinder-e454587f-7a03-4b6f-a118-978f74a5dd4e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a93e57a-9811-44e1-9ff5-12dda81398bb tempest-VolumesGetTest-168182217 None] Lock "cinder-974c437d-0156-49b5-af76-b424e532f37b-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Acquiring lock "cinder-quobyte-e454587f-7a03-4b6f-a118-978f74a5dd4e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-e454587f-7a03-4b6f-a118-978f74a5dd4e" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[28addbbf-120e-4987-9208-b9327161bead]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:11 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e Sep 28 19:10:11 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:11 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad 1073741824" returned: 0 in 0.692s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:11 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad Sep 28 19:10:11 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:11 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e" returned: 0 in 0.477s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:11 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e Sep 28 19:10:11 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:12 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad" returned: 0 in 0.307s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.864s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1447415443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd933bde-ac8d-4961-9476-05a6b9654211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:10Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Creating volume dd933bde-ac8d-4961-9476-05a6b9654211 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:12 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414f8945-d88a-4473-959b-ccddfd052756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2fa041-baf8-4ccb-bee5-c1aa30d5a0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:12 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211 1073741824 Sep 28 19:10:12 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad (9a17ba53-726c-4dad-bad5-1f3a64aa6cad): created successfully Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2fa041-baf8-4ccb-bee5-c1aa30d5a0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (79195326-8627-4f9d-a6b8-893c301683e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:12 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e454587f-7a03-4b6f-a118-978f74a5dd4e" returned: 0 in 0.327s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-290eb696-c952-4e45-bdeb-7d29ecfc4903 tempest-CreateVolumesFromSnapshotTest-714597120 None] Created volume successfully. Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Lock "cinder-quobyte-e454587f-7a03-4b6f-a118-978f74a5dd4e" released by "delete_volume" :: held 0.880s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Created reservations ['3ae446fd-dbf5-4ff7-8f15-5c3374205f4a', 'dc1d132a-ceb7-4640-8b06-b8391fee4fe6', '249a2693-fc9a-4de6-be49-d7c46be5c974', '554c26e4-dee4-4a8a-989c-0d5e1b977ded'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:12 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:12 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:12 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211 1073741824" returned: 0 in 0.659s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:12 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.427s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Deleted volume successfully. Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6b7be0d-984f-446a-aafb-f104c4be7bfc tempest-VolumesGetTest-168182217 None] Lock "cinder-e454587f-7a03-4b6f-a118-978f74a5dd4e-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:12 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211 Sep 28 19:10:12 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Flow 'volume_create_manager' (e1fdf0a6-079d-4082-b7d7-758b4a5a96da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50465847-c835-4046-9596-436d874ab2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50465847-c835-4046-9596-436d874ab2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-843353693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19ccb80-290b-452f-b2ed-c7ff823a0c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd62902b471497881791d0ec1ee4541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:13Z,use_quota=True,user_id='b1586625babb46b38fa2aba7b169ca0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5053233-89d1-4952-9992-652983e548ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5053233-89d1-4952-9992-652983e548ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d72460-1aee-4d7a-aa92-6187d3ba5fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d72460-1aee-4d7a-aa92-6187d3ba5fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19ccb80-290b-452f-b2ed-c7ff823a0c3a', 'volume_name': 'volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7a2bc8-b6f4-445f-b2e8-826585562929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7a2bc8-b6f4-445f-b2e8-826585562929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398954ce-9db9-45f1-b6c1-64c05550ec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Volume f19ccb80-290b-452f-b2ed-c7ff823a0c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a', 'volume_size': 1} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:13 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.427s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-222945407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec807ccc-714e-409f-913a-c0dbf2580a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ef9b65862b4df98476afd0fa798954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:11Z,use_quota=True,user_id='3863ccc06cd6453cb5ce3389e5d5dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Creating volume ec807ccc-714e-409f-913a-c0dbf2580a30 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:13 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f851b8b-fa43-4c05-8c46-8a5f10c2dc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd933bde-ac8d-4961-9476-05a6b9654211', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:13 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30 1073741824 Sep 28 19:10:13 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d331271-b5d0-4593-b150-0d27a8364834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume volume-dd933bde-ac8d-4961-9476-05a6b9654211 (dd933bde-ac8d-4961-9476-05a6b9654211): created successfully Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d331271-b5d0-4593-b150-0d27a8364834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (e856c978-1776-40dc-9834-ed52eda17f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-45da7e86-729b-41dc-8a4d-19ca11645a30 tempest-CreateVolumesFromSnapshotTest-714597120 None] Created volume successfully. Sep 28 19:10:13 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30 1073741824" returned: 0 in 0.592s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:13 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30 Sep 28 19:10:13 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Flow 'volume_create_manager' (15eadb2c-11ff-42c3-8e46-1e7928ca86f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7789e6-c5ca-4417-b3d3-2a89085cbbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7789e6-c5ca-4417-b3d3-2a89085cbbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1206710456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a25b76-6a8d-40f8-a05f-27ead0b74865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609bf4c760304816ab28fc6fd505fd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:14Z,use_quota=True,user_id='b88ad40501414685a3ebc1913fe73186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5845c231-d112-416d-9eb6-d4911b189032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5845c231-d112-416d-9eb6-d4911b189032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac75345-27ac-4d84-a265-d3193027af56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac75345-27ac-4d84-a265-d3193027af56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97a25b76-6a8d-40f8-a05f-27ead0b74865', 'volume_name': 'volume-97a25b76-6a8d-40f8-a05f-27ead0b74865', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa17aa1-fe62-40aa-8419-6a1620fcf45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa17aa1-fe62-40aa-8419-6a1620fcf45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8c11ee-e039-4900-a7aa-971bc441fd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Volume 97a25b76-6a8d-40f8-a05f-27ead0b74865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97a25b76-6a8d-40f8-a05f-27ead0b74865', 'volume_size': 1} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:14 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30" returned: 0 in 0.419s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.204s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-843353693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19ccb80-290b-452f-b2ed-c7ff823a0c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd62902b471497881791d0ec1ee4541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:13Z,use_quota=True,user_id='b1586625babb46b38fa2aba7b169ca0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Creating volume f19ccb80-290b-452f-b2ed-c7ff823a0c3a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:14 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2210e9-2fc1-4d2d-9778-c43612ada0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec807ccc-714e-409f-913a-c0dbf2580a30', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c82b95-4b2f-44f9-91cb-ee57c725355c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:14 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a 1073741824 Sep 28 19:10:14 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Volume volume-ec807ccc-714e-409f-913a-c0dbf2580a30 (ec807ccc-714e-409f-913a-c0dbf2580a30): created successfully Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c82b95-4b2f-44f9-91cb-ee57c725355c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Flow 'volume_create_manager' (6a69039f-bd16-4947-b9d6-859f00f98a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5c8a8398-f43c-482c-bb52-571069f326e1 tempest-CreateVolumesFromSnapshotTest-714597120 None] Created volume successfully. Sep 28 19:10:14 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a 1073741824" returned: 0 in 0.633s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:14 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a Sep 28 19:10:14 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:15 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a" returned: 0 in 0.303s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1206710456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a25b76-6a8d-40f8-a05f-27ead0b74865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609bf4c760304816ab28fc6fd505fd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:14Z,use_quota=True,user_id='b88ad40501414685a3ebc1913fe73186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Creating volume 97a25b76-6a8d-40f8-a05f-27ead0b74865 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:15 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-ec807ccc-714e-409f-913a-c0dbf2580a30-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398954ce-9db9-45f1-b6c1-64c05550ec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7e4ada-abf8-4df5-9525-ffe18c6ccdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:15 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865 1073741824 Sep 28 19:10:15 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Volume volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a (f19ccb80-290b-452f-b2ed-c7ff823a0c3a): created successfully Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7e4ada-abf8-4df5-9525-ffe18c6ccdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Flow 'volume_create_manager' (e1fdf0a6-079d-4082-b7d7-758b4a5a96da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-ec807ccc-714e-409f-913a-c0dbf2580a30-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ddb358a7-b14e-4e1c-a010-84dab33d3fe3 tempest-VolumesListAdminTestJSON-779503016 None] Created volume successfully. Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-quobyte-ec807ccc-714e-409f-913a-c0dbf2580a30" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-ec807ccc-714e-409f-913a-c0dbf2580a30" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2f05a2-bced-423d-960b-1defe0e0890a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:15 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30 Sep 28 19:10:15 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:15 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865 1073741824" returned: 0 in 0.619s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:15 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30" returned: 0 in 0.490s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:15 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865 Sep 28 19:10:15 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:15 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30 Sep 28 19:10:15 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:16 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865" returned: 0 in 0.389s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:16 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8c11ee-e039-4900-a7aa-971bc441fd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a25b76-6a8d-40f8-a05f-27ead0b74865', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769b5ca0-1b1c-4176-9d68-b184e1590b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ec807ccc-714e-409f-913a-c0dbf2580a30" returned: 0 in 0.405s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-ec807ccc-714e-409f-913a-c0dbf2580a30" released by "delete_volume" :: held 0.960s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Volume volume-97a25b76-6a8d-40f8-a05f-27ead0b74865 (97a25b76-6a8d-40f8-a05f-27ead0b74865): created successfully Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769b5ca0-1b1c-4176-9d68-b184e1590b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Flow 'volume_create_manager' (15eadb2c-11ff-42c3-8e46-1e7928ca86f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-697f947c-9292-47f9-b876-5c1e27e42475 tempest-AttachVolumeNegativeTest-969719363 None] Created volume successfully. Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Created reservations ['05a66d9e-d623-4d44-b441-eb137ac7deae', '8ec2257c-2a60-429d-b8a1-2e2aed112d65', '3a5f5213-aba3-4184-80aa-c551a8bf8c0c', 'cfc338c4-ea4c-4cc7-8bfd-c9444da0f07c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:16 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:16 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Flow 'volume_create_manager' (a979d2db-8f4c-4501-8edb-f2b91ec9a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64cc749-b63b-47e1-b022-5eeff9ff06b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64cc749-b63b-47e1-b022-5eeff9ff06b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2013701362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4046cea9-2170-4854-a6de-c9666c294bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd62902b471497881791d0ec1ee4541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:17Z,use_quota=True,user_id='b1586625babb46b38fa2aba7b169ca0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cec367-62ef-40a2-a3af-618e8bd9be51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cec367-62ef-40a2-a3af-618e8bd9be51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb45d8f-d535-4b93-9de5-d534174c351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb45d8f-d535-4b93-9de5-d534174c351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4046cea9-2170-4854-a6de-c9666c294bdf', 'volume_name': 'volume-4046cea9-2170-4854-a6de-c9666c294bdf', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc813b6a-8068-4554-9731-81f5efa56d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc813b6a-8068-4554-9731-81f5efa56d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857e2085-d5ed-4a71-9346-6a78bef1a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Volume 4046cea9-2170-4854-a6de-c9666c294bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4046cea9-2170-4854-a6de-c9666c294bdf', 'volume_size': 1} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2013701362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4046cea9-2170-4854-a6de-c9666c294bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd62902b471497881791d0ec1ee4541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:17Z,use_quota=True,user_id='b1586625babb46b38fa2aba7b169ca0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Creating volume 4046cea9-2170-4854-a6de-c9666c294bdf {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:16 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:16 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf 1073741824 Sep 28 19:10:16 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:16 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.336s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:16 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Deleted volume successfully. Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ed38ffe-7b74-4349-a88a-f0036bb90858 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-ec807ccc-714e-409f-913a-c0dbf2580a30-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-dd933bde-ac8d-4961-9476-05a6b9654211-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-dd933bde-ac8d-4961-9476-05a6b9654211-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-quobyte-dd933bde-ac8d-4961-9476-05a6b9654211" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:17 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf 1073741824" returned: 0 in 0.786s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-dd933bde-ac8d-4961-9476-05a6b9654211" acquired by "delete_volume" :: waited 0.052s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[096af583-9c28-4297-a866-16656c096d8c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:17 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf Sep 28 19:10:17 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Flow 'volume_create_manager' (4b8a39e1-1a21-4989-a40c-62805a09d016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a307880-b128-4037-99fa-79f818a722f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a307880-b128-4037-99fa-79f818a722f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1111016443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379ea5d2-4c06-4d7b-a699-a81c3e2fe226,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb89fd09bd05402693e545558d0bdf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:18Z,use_quota=True,user_id='de18350be10d46c797dca82093fcb245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e484313e-f20c-4f1f-a98c-31bdaca4d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e484313e-f20c-4f1f-a98c-31bdaca4d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56693b15-6afe-46f9-bfce-2294753d325c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56693b15-6afe-46f9-bfce-2294753d325c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379ea5d2-4c06-4d7b-a699-a81c3e2fe226', 'volume_name': 'volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f109e0d-7cbc-4444-8fa9-3a44c121e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f109e0d-7cbc-4444-8fa9-3a44c121e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:18 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211 Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d64cf3-d0a9-43dc-b4d3-0a178effe316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:18 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:18 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Volume 379ea5d2-4c06-4d7b-a699-a81c3e2fe226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226', 'volume_size': 1} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:18 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf" returned: 0 in 0.424s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.120s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1111016443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379ea5d2-4c06-4d7b-a699-a81c3e2fe226,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb89fd09bd05402693e545558d0bdf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:18Z,use_quota=True,user_id='de18350be10d46c797dca82093fcb245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Creating volume 379ea5d2-4c06-4d7b-a699-a81c3e2fe226 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:18 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857e2085-d5ed-4a71-9346-6a78bef1a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4046cea9-2170-4854-a6de-c9666c294bdf', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff09aa7d-3ac4-4ac8-bc65-745604d4b7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:18 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226 1073741824 Sep 28 19:10:18 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:18 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Volume volume-4046cea9-2170-4854-a6de-c9666c294bdf (4046cea9-2170-4854-a6de-c9666c294bdf): created successfully Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff09aa7d-3ac4-4ac8-bc65-745604d4b7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Flow 'volume_create_manager' (a979d2db-8f4c-4501-8edb-f2b91ec9a424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-af8d2b45-0ec7-4d91-bc11-f4573d73a8d3 tempest-VolumesListAdminTestJSON-779503016 None] Created volume successfully. Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-26757080-31f5-4d75-a4fd-f29fdaf37e4f req-be6203a4-acc0-4258-9881-5fb58f867560 tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:18 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211" returned: 0 in 0.631s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:18 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211 Sep 28 19:10:18 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:18 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-dd933bde-ac8d-4961-9476-05a6b9654211" returned: 0 in 0.321s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-dd933bde-ac8d-4961-9476-05a6b9654211" released by "delete_volume" :: held 1.051s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:18 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226 1073741824" returned: 0 in 0.604s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Created reservations ['ed225026-3580-404f-8a4f-6a18fd0f8f93', '01086042-3cee-4e43-a1db-e70366750107', '0ad7216d-7d26-4189-b914-f681d016f31f', '261fdab1-0d60-4e83-af51-37e33c48b3e7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:18 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226 Sep 28 19:10:18 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:19 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:19 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:19 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226" returned: 0 in 0.321s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-26757080-31f5-4d75-a4fd-f29fdaf37e4f req-be6203a4-acc0-4258-9881-5fb58f867560 tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.839s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-26757080-31f5-4d75-a4fd-f29fdaf37e4f req-be6203a4-acc0-4258-9881-5fb58f867560 tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d64cf3-d0a9-43dc-b4d3-0a178effe316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8e7296-d301-4337-82c3-d449fc2f3f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:19 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Volume volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226 (379ea5d2-4c06-4d7b-a699-a81c3e2fe226): created successfully Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8e7296-d301-4337-82c3-d449fc2f3f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:19 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Flow 'volume_create_manager' (4b8a39e1-1a21-4989-a40c-62805a09d016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.333s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-26757080-31f5-4d75-a4fd-f29fdaf37e4f req-be6203a4-acc0-4258-9881-5fb58f867560 tempest-AttachVolumeNegativeTest-969719363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-97a25b76-6a8d-40f8-a05f-27ead0b74865', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc641f88-ae0e-4ad4-8ec5-ab9e341c8613', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:10:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Deleted volume successfully. Sep 28 19:10:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-16fc8a46-fffb-4291-bc94-33785e8f0e72 tempest-VolumesListTestJSON-1920127188 None] Created volume successfully. Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e299ac6c-901f-405e-831a-97e352ebe3da tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-dd933bde-ac8d-4961-9476-05a6b9654211-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-26757080-31f5-4d75-a4fd-f29fdaf37e4f req-be6203a4-acc0-4258-9881-5fb58f867560 tempest-AttachVolumeNegativeTest-969719363 None] attachment_update completed successfully. Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Flow 'volume_create_manager' (ddfc57f2-02bf-4036-ac10-36256b973a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859acb9d-c844-4fd7-8fec-eb4b4af54ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859acb9d-c844-4fd7-8fec-eb4b4af54ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2121283361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c1e252-9ee1-4c0e-93e9-83e83be64008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd62902b471497881791d0ec1ee4541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:20Z,use_quota=True,user_id='b1586625babb46b38fa2aba7b169ca0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eb560d-00f3-409e-b8be-c9535fc9fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eb560d-00f3-409e-b8be-c9535fc9fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4297ce8-73c3-4dcb-ac5b-addde911ae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4297ce8-73c3-4dcb-ac5b-addde911ae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c1e252-9ee1-4c0e-93e9-83e83be64008', 'volume_name': 'volume-80c1e252-9ee1-4c0e-93e9-83e83be64008', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119174cd-a9da-4b2b-83cf-beac0b5cdbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119174cd-a9da-4b2b-83cf-beac0b5cdbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7d860f-5ef5-4235-8efd-fa4608f1af1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:19 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Volume 80c1e252-9ee1-4c0e-93e9-83e83be64008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c1e252-9ee1-4c0e-93e9-83e83be64008', 'volume_size': 1} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2121283361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c1e252-9ee1-4c0e-93e9-83e83be64008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cd62902b471497881791d0ec1ee4541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:20Z,use_quota=True,user_id='b1586625babb46b38fa2aba7b169ca0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Creating volume 80c1e252-9ee1-4c0e-93e9-83e83be64008 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:19 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:19 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008 1073741824 Sep 28 19:10:19 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-9a17ba53-726c-4dad-bad5-1f3a64aa6cad-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-9a17ba53-726c-4dad-bad5-1f3a64aa6cad-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-quobyte-9a17ba53-726c-4dad-bad5-1f3a64aa6cad" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-9a17ba53-726c-4dad-bad5-1f3a64aa6cad" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f8f8bf-2efe-4782-bc43-5bd49b808dd5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:20 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad Sep 28 19:10:20 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:20 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008 1073741824" returned: 0 in 0.690s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:20 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008 Sep 28 19:10:20 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:20 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad" returned: 0 in 0.711s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:20 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad Sep 28 19:10:20 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Flow 'volume_create_manager' (b4cab677-a507-4f23-aa44-0005fd333485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:20 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24729f9f-b28b-4a2f-936e-07754814b1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24729f9f-b28b-4a2f-936e-07754814b1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-241646625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4238dfc3-c7aa-4fe1-97bd-f7663321089d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb89fd09bd05402693e545558d0bdf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:21Z,use_quota=True,user_id='de18350be10d46c797dca82093fcb245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f44bd7-49f1-4f48-b635-2dd4ff9385d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f44bd7-49f1-4f48-b635-2dd4ff9385d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c56b52-21a5-496b-94eb-3cbb4c322818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c56b52-21a5-496b-94eb-3cbb4c322818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4238dfc3-c7aa-4fe1-97bd-f7663321089d', 'volume_name': 'volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (face5868-38a6-46c6-b965-9d123761ed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (face5868-38a6-46c6-b965-9d123761ed00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1f7bec-ffbd-4fac-9e74-338793542e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:21 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Volume 4238dfc3-c7aa-4fe1-97bd-f7663321089d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d', 'volume_size': 1} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-241646625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4238dfc3-c7aa-4fe1-97bd-f7663321089d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb89fd09bd05402693e545558d0bdf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:21Z,use_quota=True,user_id='de18350be10d46c797dca82093fcb245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Creating volume 4238dfc3-c7aa-4fe1-97bd-f7663321089d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:21 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7d860f-5ef5-4235-8efd-fa4608f1af1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c1e252-9ee1-4c0e-93e9-83e83be64008', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6891305-9171-4d9a-9c65-93fec411221c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:21 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d 1073741824 Sep 28 19:10:21 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:21 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Volume volume-80c1e252-9ee1-4c0e-93e9-83e83be64008 (80c1e252-9ee1-4c0e-93e9-83e83be64008): created successfully Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6891305-9171-4d9a-9c65-93fec411221c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Flow 'volume_create_manager' (ddfc57f2-02bf-4036-ac10-36256b973a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a7b71250-6c5a-4aa6-957e-dbe9d44eae28 tempest-VolumesListAdminTestJSON-779503016 None] Created volume successfully. Sep 28 19:10:21 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9a17ba53-726c-4dad-bad5-1f3a64aa6cad" returned: 0 in 0.356s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-9a17ba53-726c-4dad-bad5-1f3a64aa6cad" released by "delete_volume" :: held 1.136s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Created reservations ['c41a137b-afcd-4ad3-829e-c8d3485f3fd8', 'bfc14494-6bd3-4a2e-b5ad-0bcb044e24f0', '2a87ba39-1f20-448b-8e3d-b313d0821975', '914da880-7117-47c0-bfd5-409868747386'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:21 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:21 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:21 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d 1073741824" returned: 0 in 0.582s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:21 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.317s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Deleted volume successfully. Sep 28 19:10:21 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d Sep 28 19:10:21 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-36fe326d-3bd8-44c4-b8a9-760cfb6a35d8 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-9a17ba53-726c-4dad-bad5-1f3a64aa6cad-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:22 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1f7bec-ffbd-4fac-9e74-338793542e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165a5019-157a-4ae1-94b7-4f91da4aecfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:22 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Volume volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d (4238dfc3-c7aa-4fe1-97bd-f7663321089d): created successfully Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165a5019-157a-4ae1-94b7-4f91da4aecfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Flow 'volume_create_manager' (b4cab677-a507-4f23-aa44-0005fd333485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dde4935f-f2d4-428f-9410-b5c22a7b59e4 tempest-VolumesListTestJSON-1920127188 None] Created volume successfully. Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-60b3b702-909e-453c-966e-47eb3831fc16-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-60b3b702-909e-453c-966e-47eb3831fc16-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-quobyte-60b3b702-909e-453c-966e-47eb3831fc16" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-60b3b702-909e-453c-966e-47eb3831fc16" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[146728c3-8fd5-4178-89e7-73691433aa50]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:22 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16 Sep 28 19:10:22 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:23 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16" returned: 0 in 0.557s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:23 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16 Sep 28 19:10:23 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Flow 'volume_create_manager' (b6d360b6-c071-4fc2-ab30-8cda6050acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e5564c-3d4d-4176-bbda-0e1e380c563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e5564c-3d4d-4176-bbda-0e1e380c563b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fddf2406-95b5-4926-9622-67e5b4f09522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f84b8f09aa5476bb23abcff620b7e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:23Z,use_quota=True,user_id='efa63449d6f34c74a66f12b2424c606b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2041a8b1-8eaf-419b-9899-8f7f5b88ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2041a8b1-8eaf-419b-9899-8f7f5b88ba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e19ec0c-4866-4b59-b076-a4edc186bb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e19ec0c-4866-4b59-b076-a4edc186bb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fddf2406-95b5-4926-9622-67e5b4f09522', 'volume_name': 'volume-fddf2406-95b5-4926-9622-67e5b4f09522', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa873a5a-97c1-47b3-9423-8c173db08530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa873a5a-97c1-47b3-9423-8c173db08530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b21792-232c-4105-a70d-25e719f2cd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Volume fddf2406-95b5-4926-9622-67e5b4f09522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fddf2406-95b5-4926-9622-67e5b4f09522', 'volume_size': 1} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fddf2406-95b5-4926-9622-67e5b4f09522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f84b8f09aa5476bb23abcff620b7e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:23Z,use_quota=True,user_id='efa63449d6f34c74a66f12b2424c606b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Creating volume fddf2406-95b5-4926-9622-67e5b4f09522 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:23 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-6236e5bb-c758-4356-967a-1cbf0e2cf649 req-27d9a0c1-61eb-4b6a-b764-62aab1140455 tempest-AttachVolumeNegativeTest-969719363 None] Terminate volume connection completed successfully. Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-6236e5bb-c758-4356-967a-1cbf0e2cf649 req-27d9a0c1-61eb-4b6a-b764-62aab1140455 tempest-AttachVolumeNegativeTest-969719363 None] Deleting attachment bc641f88-ae0e-4ad4-8ec5-ab9e341c8613. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:10:23 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522 1073741824 Sep 28 19:10:23 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:23 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-60b3b702-909e-453c-966e-47eb3831fc16" returned: 0 in 0.476s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-60b3b702-909e-453c-966e-47eb3831fc16" released by "delete_volume" :: held 1.139s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Created reservations ['034aebf4-b55b-4f96-b52f-044e1ed608e3', '0b6fdb4a-91e1-4899-bf1a-207121645ba1', '93af2b30-c2b9-4edf-91b2-1dc1c4c9eb6d', 'eea0d48d-4335-471b-935f-96795010b7c2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:23 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:23 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Flow 'volume_create_manager' (3fed6fa4-2c3c-4664-b71b-0506c24c6621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce236184-e70a-414f-9372-5826482e6adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce236184-e70a-414f-9372-5826482e6adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-253298666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe72774-dff7-45ae-bd58-7c5827466219,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb89fd09bd05402693e545558d0bdf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:24Z,use_quota=True,user_id='de18350be10d46c797dca82093fcb245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c56d9b-d346-4ba0-8cca-b67eba8adc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c56d9b-d346-4ba0-8cca-b67eba8adc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671a3472-645c-4bea-84e9-d386df61c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671a3472-645c-4bea-84e9-d386df61c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe72774-dff7-45ae-bd58-7c5827466219', 'volume_name': 'volume-2fe72774-dff7-45ae-bd58-7c5827466219', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e971619-ef1e-4654-aa3c-014d22ee0d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e971619-ef1e-4654-aa3c-014d22ee0d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0938be-f182-4b22-add5-0b8831622613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Volume 2fe72774-dff7-45ae-bd58-7c5827466219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe72774-dff7-45ae-bd58-7c5827466219', 'volume_size': 1} Sep 28 19:10:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:24 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522 1073741824" returned: 0 in 0.829s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:24 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.424s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:24 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522 Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:24 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Deleted volume successfully. Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d6805a1-2808-403f-a702-0d3df4320f37 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-60b3b702-909e-453c-966e-47eb3831fc16-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:24 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522" returned: 0 in 0.330s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-253298666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe72774-dff7-45ae-bd58-7c5827466219,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb89fd09bd05402693e545558d0bdf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:24Z,use_quota=True,user_id='de18350be10d46c797dca82093fcb245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Creating volume 2fe72774-dff7-45ae-bd58-7c5827466219 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:24 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:24 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219 1073741824 Sep 28 19:10:24 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b21792-232c-4105-a70d-25e719f2cd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fddf2406-95b5-4926-9622-67e5b4f09522', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52fa21a-2a43-4e52-9e6f-4d765d2bbffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:24 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Volume volume-fddf2406-95b5-4926-9622-67e5b4f09522 (fddf2406-95b5-4926-9622-67e5b4f09522): created successfully Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52fa21a-2a43-4e52-9e6f-4d765d2bbffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Flow 'volume_create_manager' (b6d360b6-c071-4fc2-ab30-8cda6050acdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2d0519c1-c9eb-4dd5-80c9-43e4d1b7477c tempest-VolumesListAdminTestJSON-667962264 None] Created volume successfully. Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-b4eea6c9-06f5-4347-8df1-50a953b6ac0d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-b4eea6c9-06f5-4347-8df1-50a953b6ac0d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-quobyte-b4eea6c9-06f5-4347-8df1-50a953b6ac0d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-b4eea6c9-06f5-4347-8df1-50a953b6ac0d" acquired by "delete_volume" :: waited 0.047s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd717fd-6a42-4471-8623-7a5717e937a2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:25 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d Sep 28 19:10:25 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:25 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219 1073741824" returned: 0 in 0.925s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Acquiring lock "cinder-fddf2406-95b5-4926-9622-67e5b4f09522-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Lock "cinder-fddf2406-95b5-4926-9622-67e5b4f09522-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Acquiring lock "cinder-quobyte-fddf2406-95b5-4926-9622-67e5b4f09522" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:25 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219 Sep 28 19:10:25 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Lock "cinder-quobyte-fddf2406-95b5-4926-9622-67e5b4f09522" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81f7c1d-54e7-4598-a0f2-6287f503d8b1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:25 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "cinder-80c1e252-9ee1-4c0e-93e9-83e83be64008-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d" returned: 0 in 0.754s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:25 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522 Sep 28 19:10:25 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:25 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d Sep 28 19:10:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-80c1e252-9ee1-4c0e-93e9-83e83be64008-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:25 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "cinder-quobyte-80c1e252-9ee1-4c0e-93e9-83e83be64008" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-quobyte-80c1e252-9ee1-4c0e-93e9-83e83be64008" acquired by "delete_volume" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd25e849-daac-41a0-aef5-53609de096cb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:26 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219" returned: 0 in 0.610s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0938be-f182-4b22-add5-0b8831622613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe72774-dff7-45ae-bd58-7c5827466219', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f4823a-1418-45b6-a7c5-57493eb9de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:26 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008 Sep 28 19:10:26 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:26 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Volume volume-2fe72774-dff7-45ae-bd58-7c5827466219 (2fe72774-dff7-45ae-bd58-7c5827466219): created successfully Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f4823a-1418-45b6-a7c5-57493eb9de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Flow 'volume_create_manager' (3fed6fa4-2c3c-4664-b71b-0506c24c6621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:26 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0cd2205b-18e9-4cfc-b4b8-abbfd112c295 tempest-VolumesListTestJSON-1920127188 None] Created volume successfully. Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b4eea6c9-06f5-4347-8df1-50a953b6ac0d" returned: 0 in 0.541s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-b4eea6c9-06f5-4347-8df1-50a953b6ac0d" released by "delete_volume" :: held 1.395s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:26 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522" returned: 0 in 0.766s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:26 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522 Sep 28 19:10:26 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Created reservations ['44cec6dc-fd73-4f5a-a6a2-34bc480aa0bd', '5b6fe10d-8003-4ac2-a9ad-2124bfff939e', '9b986bcc-457a-41fd-a6e0-02f2e96e71bb', '2aa0beff-1606-47a8-b7af-e312397bf3a3'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:26 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:26 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:26 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008" returned: 0 in 0.613s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:26 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008 Sep 28 19:10:26 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:26 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fddf2406-95b5-4926-9622-67e5b4f09522" returned: 0 in 0.462s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Lock "cinder-quobyte-fddf2406-95b5-4926-9622-67e5b4f09522" released by "delete_volume" :: held 1.322s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:27 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.412s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Deleted volume successfully. Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-091aaf96-c025-4d15-844d-dde1c742777f tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-b4eea6c9-06f5-4347-8df1-50a953b6ac0d-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Created reservations ['c934fdc2-0daa-496c-8bf2-9dfcf10147fb', 'c03126a5-7356-4b13-8b35-4eb33ae7b3d2', '3fd2449a-01d9-4e48-931f-c1a2ebf4917f', '80220206-d5cc-433a-8a29-1df435912d7a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:27 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-3c11cb6c-31d5-4a2e-a061-11452c7fdc8e-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-80c1e252-9ee1-4c0e-93e9-83e83be64008" returned: 0 in 0.580s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-quobyte-80c1e252-9ee1-4c0e-93e9-83e83be64008" released by "delete_volume" :: held 1.311s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-3c11cb6c-31d5-4a2e-a061-11452c7fdc8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-quobyte-babc48ae-08c8-4147-89e2-abff499b24d6" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-babc48ae-08c8-4147-89e2-abff499b24d6" acquired by "delete_snapshot" :: waited 0.087s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-quobyte-3c11cb6c-31d5-4a2e-a061-11452c7fdc8e" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:27 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:27 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-3c11cb6c-31d5-4a2e-a061-11452c7fdc8e" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Deleting offline snapshot 3c11cb6c-31d5-4a2e-a061-11452c7fdc8e of volume babc48ae-08c8-4147-89e2-abff499b24d6 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] snapshot_file for this snap is: volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3447bb19-de81-41ac-878f-2bfc50c554b6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Created reservations ['00b08f9c-1552-4774-87e7-1c8848669bb8', 'b75e50ab-0eb1-47b4-aa5e-0fd313d7ca72', '5744a5a7-006f-43c6-9c6c-525affb6808c', '1e7144eb-ff5e-4c64-88cc-c70dcf55a8e2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:28 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:28 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e Sep 28 19:10:28 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.534s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Deleted volume successfully. Sep 28 19:10:28 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:28 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-554a5eee-87f7-4219-b9b0-63f7aa47876a tempest-VolumesListAdminTestJSON-667962264 None] Lock "cinder-fddf2406-95b5-4926-9622-67e5b4f09522-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "cinder-4046cea9-2170-4854-a6de-c9666c294bdf-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-4046cea9-2170-4854-a6de-c9666c294bdf-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:28 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e" returned: 0 in 0.811s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-babc48ae-08c8-4147-89e2-abff499b24d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "cinder-quobyte-4046cea9-2170-4854-a6de-c9666c294bdf" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f99e6b-0cef-4edb-9a46-8caa879b5fb7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-quobyte-4046cea9-2170-4854-a6de-c9666c294bdf" acquired by "delete_volume" :: waited 0.050s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:28 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.688s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Deleted volume successfully. Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[940c0808-960f-4d7b-b001-2054ee1ce84a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-153e5716-8150-4d74-ac8d-7326f8b82a13 tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-80c1e252-9ee1-4c0e-93e9-83e83be64008-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:28 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 Sep 28 19:10:28 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:28 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf Sep 28 19:10:28 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:29 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6" returned: 0 in 0.542s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:29 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e Sep 28 19:10:29 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:29 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf" returned: 0 in 0.480s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:29 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf Sep 28 19:10:29 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:29 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e" returned: 0 in 0.400s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:29 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4046cea9-2170-4854-a6de-c9666c294bdf" returned: 0 in 0.354s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-quobyte-4046cea9-2170-4854-a6de-c9666c294bdf" released by "delete_volume" :: held 0.933s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:29 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e Sep 28 19:10:29 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Created reservations ['d6251cd7-16ef-440e-9c2a-1e74cf234c5c', '785f8cc0-cb92-4c3e-a2f5-de6bb0884f94', 'c14b63b7-241b-4e88-bae2-c390531fe1dc', 'c3fa0d93-167e-4293-9145-31a8202fdd2d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:29 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:29 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:29 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6.3c11cb6c-31d5-4a2e-a061-11452c7fdc8e" returned: 0 in 0.379s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-3c11cb6c-31d5-4a2e-a061-11452c7fdc8e" released by "_delete_snapshot" :: held 2.436s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-babc48ae-08c8-4147-89e2-abff499b24d6" released by "delete_snapshot" :: held 2.517s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Created reservations ['5fc21e3a-e145-44ef-aa73-caf62d0869d5', '9239c502-b6a4-4558-a7dd-af85eb77f255', 'd85f0768-1f1b-4c24-bf10-8100bc3a4235', '02b53475-706d-4e91-a9cd-c5f0a372e577'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Delete snapshot completed successfully. Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-43a60dff-6f40-4b67-b3d5-a769e893665c tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-3c11cb6c-31d5-4a2e-a061-11452c7fdc8e-delete_snapshot" released by "delete_snapshot" :: held 2.782s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:30 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Deleted volume successfully. Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-88bb6136-c3bc-472d-a6b0-869a6533b236 tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-4046cea9-2170-4854-a6de-c9666c294bdf-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "cinder-2fe72774-dff7-45ae-bd58-7c5827466219-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-2fe72774-dff7-45ae-bd58-7c5827466219-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "cinder-quobyte-2fe72774-dff7-45ae-bd58-7c5827466219" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-quobyte-2fe72774-dff7-45ae-bd58-7c5827466219" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14bb46b-2d12-44c3-9873-edb55f0044fb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-babc48ae-08c8-4147-89e2-abff499b24d6-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-babc48ae-08c8-4147-89e2-abff499b24d6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "cinder-quobyte-babc48ae-08c8-4147-89e2-abff499b24d6" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:30 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219 Sep 28 19:10:30 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-babc48ae-08c8-4147-89e2-abff499b24d6" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e69fddf-f884-45d1-9ea3-106e5ecdfbaa]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "cinder-f19ccb80-290b-452f-b2ed-c7ff823a0c3a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-f19ccb80-290b-452f-b2ed-c7ff823a0c3a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "cinder-quobyte-f19ccb80-290b-452f-b2ed-c7ff823a0c3a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:31 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 Sep 28 19:10:31 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-quobyte-f19ccb80-290b-452f-b2ed-c7ff823a0c3a" acquired by "delete_volume" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78738e0-00ee-4dbf-bdbc-7fc368d145f0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:31 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219" returned: 0 in 0.606s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:31 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219 Sep 28 19:10:31 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:31 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a Sep 28 19:10:31 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:31 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6" returned: 0 in 0.599s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:31 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6 Sep 28 19:10:31 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:31 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2fe72774-dff7-45ae-bd58-7c5827466219" returned: 0 in 0.374s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-quobyte-2fe72774-dff7-45ae-bd58-7c5827466219" released by "delete_volume" :: held 1.042s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:31 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a" returned: 0 in 0.582s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:31 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a Sep 28 19:10:31 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Created reservations ['ba4d64d2-f9aa-4529-beee-559650cf5aec', '7d6f5ba9-86f2-4c5d-8a42-d7d56b3c83cd', 'db112d96-2be8-49be-8944-387cbfb0fd37', '3b9bb610-7578-4b08-93d3-cd5e13a3f0d8'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:31 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-babc48ae-08c8-4147-89e2-abff499b24d6" returned: 0 in 0.405s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-quobyte-babc48ae-08c8-4147-89e2-abff499b24d6" released by "delete_volume" :: held 1.126s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:32 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:32 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Created reservations ['c64296d3-016a-45e7-a19b-953290aa53c5', '986306bc-a21f-4a1b-9a5c-980ac2f2a629', '2764bccc-f905-4399-916a-a35b18b04104', '589be126-f1a8-457b-a92a-1e599ad2ef8f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:32 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f19ccb80-290b-452f-b2ed-c7ff823a0c3a" returned: 0 in 0.544s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:32 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:32 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-quobyte-f19ccb80-290b-452f-b2ed-c7ff823a0c3a" released by "delete_volume" :: held 1.206s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Created reservations ['634f79a0-7b43-40d7-a420-ee9babf1ef93', 'a520035e-73af-4361-a647-9d0c2a0897c5', 'd01f871c-6a99-4db7-ae1b-c502f0317614', '3bb4324a-06c2-42af-be6f-2b690597f5cf'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:32 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.440s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Deleted volume successfully. Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6ff89b19-44e4-4947-a0e8-7d1511452726 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-2fe72774-dff7-45ae-bd58-7c5827466219-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:32 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:32 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:32 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Deleted volume successfully. Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a28d70f-7b2f-4355-8919-8c8f32bc7695 tempest-CreateVolumesFromSnapshotTest-714597120 None] Lock "cinder-babc48ae-08c8-4147-89e2-abff499b24d6-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:32 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Deleted volume successfully. Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d4694a8-b446-4d95-8d9d-849be3fa1e0b tempest-VolumesListAdminTestJSON-779503016 None] Lock "cinder-f19ccb80-290b-452f-b2ed-c7ff823a0c3a-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "cinder-4238dfc3-c7aa-4fe1-97bd-f7663321089d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-4238dfc3-c7aa-4fe1-97bd-f7663321089d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "cinder-quobyte-4238dfc3-c7aa-4fe1-97bd-f7663321089d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-quobyte-4238dfc3-c7aa-4fe1-97bd-f7663321089d" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b6baf1-d8a8-4482-9c28-1a98cbc8c36f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:33 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d Sep 28 19:10:33 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:33 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d" returned: 0 in 0.671s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:33 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d Sep 28 19:10:33 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:34 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4238dfc3-c7aa-4fe1-97bd-f7663321089d" returned: 0 in 0.451s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-quobyte-4238dfc3-c7aa-4fe1-97bd-f7663321089d" released by "delete_volume" :: held 1.187s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Created reservations ['67756ee1-b6c3-4d72-8b2f-fa569d1e7e34', '91260ded-adb0-4ef5-9d53-519258d58bc8', '78f6f1f8-9f2d-40fd-ad7d-da5bafd91a14', 'bf9f2d29-4bd9-48cf-b504-fdea175af2be'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:34 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:34 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:34 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:34 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:34 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.376s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Deleted volume successfully. Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-09fc9dde-9679-4ae1-bd64-7866bb346dd0 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-4238dfc3-c7aa-4fe1-97bd-f7663321089d-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:34 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.366s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:10:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:10:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:10:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "cinder-379ea5d2-4c06-4d7b-a699-a81c3e2fe226-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-379ea5d2-4c06-4d7b-a699-a81c3e2fe226-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "cinder-quobyte-379ea5d2-4c06-4d7b-a699-a81c3e2fe226" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-quobyte-379ea5d2-4c06-4d7b-a699-a81c3e2fe226" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc255c5-0ec0-44a8-a917-f61b1ad61df4]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:35 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226 Sep 28 19:10:35 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:36 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226" returned: 0 in 0.612s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:36 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226 Sep 28 19:10:36 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:36 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-379ea5d2-4c06-4d7b-a699-a81c3e2fe226" returned: 0 in 0.473s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-quobyte-379ea5d2-4c06-4d7b-a699-a81c3e2fe226" released by "delete_volume" :: held 1.149s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Created reservations ['96051d57-520d-4baa-b010-42e9a9150a9d', '3502002d-4623-4444-81bd-cf284f141d39', 'b5e205ad-5817-4eb4-b41d-59af12ad213e', 'b99c24cf-7fa0-4e83-a4f7-055407f53d03'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:36 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:36 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:37 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.426s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:37 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Deleted volume successfully. Sep 28 19:10:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-64d86e72-4c6a-476a-bd86-ed17c3468304 tempest-VolumesListTestJSON-1920127188 None] Lock "cinder-379ea5d2-4c06-4d7b-a699-a81c3e2fe226-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=223,cinder:SELECT=170,cinder:INSERT=69,cinder:DELETE=21 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=241,cinder:SELECT=167,cinder:INSERT=59,cinder:DELETE=20 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Flow 'volume_create_manager' (47cd2b73-ea63-45a7-b822-5980b16c7fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f339099-eff1-42f1-a7d4-e38c0752ed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f339099-eff1-42f1-a7d4-e38c0752ed31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d81b71-f4e7-46b6-8375-3860646d3e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47e6b4daf7c41448d5dbc220a1bd20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:38Z,use_quota=True,user_id='48ed52ccb3664a518306a62d78c8dc1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac9f062-db41-483d-ba7d-22ee338fefca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac9f062-db41-483d-ba7d-22ee338fefca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea712cf-a37d-4cc5-b8f9-39f53d6e09ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea712cf-a37d-4cc5-b8f9-39f53d6e09ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d81b71-f4e7-46b6-8375-3860646d3e35', 'volume_name': 'volume-b1d81b71-f4e7-46b6-8375-3860646d3e35', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d8a1ba-3f9c-4864-8e29-45538d7f1cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d8a1ba-3f9c-4864-8e29-45538d7f1cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbcaa97-fca6-46e5-a218-4f2ae0094c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Volume b1d81b71-f4e7-46b6-8375-3860646d3e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d81b71-f4e7-46b6-8375-3860646d3e35', 'volume_size': 1} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d81b71-f4e7-46b6-8375-3860646d3e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47e6b4daf7c41448d5dbc220a1bd20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:38Z,use_quota=True,user_id='48ed52ccb3664a518306a62d78c8dc1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Creating volume b1d81b71-f4e7-46b6-8375-3860646d3e35 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:38 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:38 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35 1073741824 Sep 28 19:10:38 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:39 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35 1073741824" returned: 0 in 0.967s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:39 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35 Sep 28 19:10:39 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:40 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35" returned: 0 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbcaa97-fca6-46e5-a218-4f2ae0094c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d81b71-f4e7-46b6-8375-3860646d3e35', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153da2d1-3fec-44be-b15e-39460794fdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:40 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Volume volume-b1d81b71-f4e7-46b6-8375-3860646d3e35 (b1d81b71-f4e7-46b6-8375-3860646d3e35): created successfully Sep 28 19:10:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153da2d1-3fec-44be-b15e-39460794fdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Flow 'volume_create_manager' (47cd2b73-ea63-45a7-b822-5980b16c7fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6950f248-3f76-4db4-a774-9233a6d91a80 tempest-CinderUnicodeTest-1848763065 None] Created volume successfully. Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Flow 'volume_create_manager' (5b37ecbe-be11-4104-89f4-142f4d24440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70452d40-8555-4b5c-a813-56bcaa94696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70452d40-8555-4b5c-a813-56bcaa94696b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1848373511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a452dea1-c189-4190-a566-372609c01ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47e6b4daf7c41448d5dbc220a1bd20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:41Z,use_quota=True,user_id='48ed52ccb3664a518306a62d78c8dc1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd3523e-db03-4764-b3cb-0de58d3cdea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd3523e-db03-4764-b3cb-0de58d3cdea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955c18ad-f48d-4535-8db9-883f81e2b965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955c18ad-f48d-4535-8db9-883f81e2b965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a452dea1-c189-4190-a566-372609c01ae7', 'volume_name': 'volume-a452dea1-c189-4190-a566-372609c01ae7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec865ca-b879-4b5f-88e8-995fe506785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec865ca-b879-4b5f-88e8-995fe506785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fe776b-7dba-40d8-906c-9b11989976a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Volume a452dea1-c189-4190-a566-372609c01ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a452dea1-c189-4190-a566-372609c01ae7', 'volume_size': 1} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1848373511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a452dea1-c189-4190-a566-372609c01ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47e6b4daf7c41448d5dbc220a1bd20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:41Z,use_quota=True,user_id='48ed52ccb3664a518306a62d78c8dc1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Creating volume a452dea1-c189-4190-a566-372609c01ae7 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:41 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:41 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 1073741824 Sep 28 19:10:41 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:42 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 1073741824" returned: 0 in 0.737s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:42 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 Sep 28 19:10:42 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:42 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fe776b-7dba-40d8-906c-9b11989976a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a452dea1-c189-4190-a566-372609c01ae7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a741288-eddc-4a35-9618-eb63b181397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Volume volume-a452dea1-c189-4190-a566-372609c01ae7 (a452dea1-c189-4190-a566-372609c01ae7): created successfully Sep 28 19:10:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a741288-eddc-4a35-9618-eb63b181397d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Flow 'volume_create_manager' (5b37ecbe-be11-4104-89f4-142f4d24440c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c917f31b-3907-4184-9408-6e17a6ebba74 tempest-CinderUnicodeTest-1848763065 None] Created volume successfully. Sep 28 19:10:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Creating offline snapshot 0fc842ff-4491-4c62-a9ef-f15b4b6132b7 of volume a452dea1-c189-4190-a566-372609c01ae7 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:10:44 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f08b06-22fd-4c65-9b20-d3dcf1ac872a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:44 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 Sep 28 19:10:44 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:45 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7" returned: 0 in 0.618s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:45 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 1G Sep 28 19:10:45 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:45 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Flow 'volume_create_manager' (b5efdecf-87e2-4af8-9748-60bdeaa58ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e71e43f-efb7-4f98-a96d-c81573363b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e71e43f-efb7-4f98-a96d-c81573363b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-285573238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12037a11-a873-462d-a5f9-f65077d4b593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc960f52fada41f193debeb483542603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:46Z,use_quota=True,user_id='76ab692b69dc4d53a72ed9c265c81183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b035f0-e660-492b-8bd1-fe7310d4e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b035f0-e660-492b-8bd1-fe7310d4e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666a9b7d-3870-4557-a668-7e75cb55f4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666a9b7d-3870-4557-a668-7e75cb55f4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12037a11-a873-462d-a5f9-f65077d4b593', 'volume_name': 'volume-12037a11-a873-462d-a5f9-f65077d4b593', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e9eb0c-f88c-4025-932f-375c48005b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e9eb0c-f88c-4025-932f-375c48005b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f317574-da74-45b8-adc5-c0236cc5f2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Volume 12037a11-a873-462d-a5f9-f65077d4b593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12037a11-a873-462d-a5f9-f65077d4b593', 'volume_size': 1} Sep 28 19:10:46 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 1G" returned: 0 in 0.906s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a452dea1-c189-4190-a566-372609c01ae7 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:46 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a452dea1-c189-4190-a566-372609c01ae7 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 Sep 28 19:10:46 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:46 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a452dea1-c189-4190-a566-372609c01ae7 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:46 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 is being set with open permissions: ugo+rw Sep 28 19:10:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:46 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 Sep 28 19:10:46 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:47 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7" returned: 0 in 0.435s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:47 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.info Sep 28 19:10:47 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:47 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.info" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:47 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.info is being set with open permissions: ugo+rw Sep 28 19:10:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:47 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.info Sep 28 19:10:47 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:48 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.info" returned: 0 in 0.383s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.501s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-285573238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12037a11-a873-462d-a5f9-f65077d4b593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc960f52fada41f193debeb483542603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:46Z,use_quota=True,user_id='76ab692b69dc4d53a72ed9c265c81183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Creating volume 12037a11-a873-462d-a5f9-f65077d4b593 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:48 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:48 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593 1073741824 Sep 28 19:10:48 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-57b85f6d-23e7-43b4-a3b7-98412cc81a51 tempest-CinderUnicodeTest-1848763065 None] Create snapshot completed successfully Sep 28 19:10:48 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593 1073741824" returned: 0 in 0.800s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "cinder-0fc842ff-4491-4c62-a9ef-f15b4b6132b7-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:49 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593 Sep 28 19:10:49 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-0fc842ff-4491-4c62-a9ef-f15b4b6132b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.108s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "cinder-quobyte-a452dea1-c189-4190-a566-372609c01ae7" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-quobyte-a452dea1-c189-4190-a566-372609c01ae7" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "cinder-quobyte-0fc842ff-4491-4c62-a9ef-f15b4b6132b7" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-quobyte-0fc842ff-4491-4c62-a9ef-f15b4b6132b7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Deleting offline snapshot 0fc842ff-4491-4c62-a9ef-f15b4b6132b7 of volume a452dea1-c189-4190-a566-372609c01ae7 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] snapshot_file for this snap is: volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec71a6a4-fa4c-4da3-8498-fe6571f7ffb9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:49 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 Sep 28 19:10:49 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:49 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593" returned: 0 in 0.628s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f317574-da74-45b8-adc5-c0236cc5f2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12037a11-a873-462d-a5f9-f65077d4b593', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410204cd-d5ae-47c7-a493-e14b52ba694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Volume volume-12037a11-a873-462d-a5f9-f65077d4b593 (12037a11-a873-462d-a5f9-f65077d4b593): created successfully Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410204cd-d5ae-47c7-a493-e14b52ba694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Flow 'volume_create_manager' (b5efdecf-87e2-4af8-9748-60bdeaa58ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-18ee6ca8-f0c4-4400-9ed0-2193a56ea1b7 tempest-VolumesTransfersV357Test-134643351 None] Created volume successfully. Sep 28 19:10:50 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7" returned: 0 in 0.732s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a452dea1-c189-4190-a566-372609c01ae7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:10:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfab123c-dc34-4594-b5af-8864928e949a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:50 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 Sep 28 19:10:50 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:50 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7" returned: 0 in 0.731s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:50 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 Sep 28 19:10:50 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:51 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7" returned: 0 in 0.668s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:51 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7 Sep 28 19:10:51 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b9f3ae53-1750-48e8-903d-ba57cf1bf4fa tempest-VolumesTransfersV357Test-644284344 None] Transfer volume completed successfully. Sep 28 19:10:52 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7.0fc842ff-4491-4c62-a9ef-f15b4b6132b7" returned: 0 in 0.617s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-quobyte-0fc842ff-4491-4c62-a9ef-f15b4b6132b7" released by "_delete_snapshot" :: held 3.012s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-quobyte-a452dea1-c189-4190-a566-372609c01ae7" released by "delete_snapshot" :: held 3.044s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:52 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Created reservations ['de194020-be5b-4ec5-aada-e7b2bb8ce4ee', 'b9d66418-164f-4558-ad71-afce3954aa0f', '2ffdcc79-def3-42d2-9437-086f60c6517a', '3b631536-90a5-486d-b59e-60a5184b3392'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Delete snapshot completed successfully. Sep 28 19:10:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b1cd8b1-825d-4190-88be-177cfa6a5cb9 tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-0fc842ff-4491-4c62-a9ef-f15b4b6132b7-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Acquiring lock "cinder-12037a11-a873-462d-a5f9-f65077d4b593-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Lock "cinder-12037a11-a873-462d-a5f9-f65077d4b593-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Acquiring lock "cinder-quobyte-12037a11-a873-462d-a5f9-f65077d4b593" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Lock "cinder-quobyte-12037a11-a873-462d-a5f9-f65077d4b593" acquired by "delete_volume" :: waited 0.048s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9721150a-bc48-48a0-b61c-c69d032f4aea]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "cinder-a452dea1-c189-4190-a566-372609c01ae7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-a452dea1-c189-4190-a566-372609c01ae7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "cinder-quobyte-a452dea1-c189-4190-a566-372609c01ae7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-quobyte-a452dea1-c189-4190-a566-372609c01ae7" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:53 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593 Sep 28 19:10:53 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[64679562-a61d-4cad-900b-16dc691df890]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:54 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 Sep 28 19:10:54 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:54 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593" returned: 0 in 1.026s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:54 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593 Sep 28 19:10:54 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:54 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7" returned: 0 in 0.820s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:54 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7 Sep 28 19:10:54 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:54 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-12037a11-a873-462d-a5f9-f65077d4b593" returned: 0 in 0.418s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Lock "cinder-quobyte-12037a11-a873-462d-a5f9-f65077d4b593" released by "delete_volume" :: held 1.658s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Created reservations ['9cf5eb24-a9da-47fe-92f0-51974c813082', '43e7f4b3-324d-4656-8ce1-03ac7101c9e1', '68a70825-faf5-467d-b89e-7fb660339297', 'f998608f-eb0c-4553-83f6-d7d9c764262f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:55 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a452dea1-c189-4190-a566-372609c01ae7" returned: 0 in 0.398s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-quobyte-a452dea1-c189-4190-a566-372609c01ae7" released by "delete_volume" :: held 1.384s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Created reservations ['bfe73733-810c-47bc-8af5-52b24e5b82de', 'd3e65e6e-5417-4ce1-be87-6ce05958baac', 'fcf7efb5-8074-45d5-899e-dd7d6f613e06', '95089553-07ca-490a-a248-ac089c6b785b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:55 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:55 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:55 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:55 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:55 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.375s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Deleted volume successfully. Sep 28 19:10:55 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.566s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Deleted volume successfully. Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4f43125a-a1f7-4721-9a38-f600144cd556 tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-a452dea1-c189-4190-a566-372609c01ae7-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d3a4a995-efea-4dc2-927d-78b062e6807d tempest-VolumesTransfersV357Test-1543475700 None] Lock "cinder-12037a11-a873-462d-a5f9-f65077d4b593-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "cinder-b1d81b71-f4e7-46b6-8375-3860646d3e35-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-b1d81b71-f4e7-46b6-8375-3860646d3e35-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "cinder-quobyte-b1d81b71-f4e7-46b6-8375-3860646d3e35" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-quobyte-b1d81b71-f4e7-46b6-8375-3860646d3e35" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22c16ec-718c-46d8-a45d-fb90710fec5e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:56 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35 Sep 28 19:10:56 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Flow 'volume_create_manager' (f1d7ffc5-c7b6-44e0-90f1-6dc38d9c3366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08952e7-285e-4de1-848d-9b013c816aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08952e7-285e-4de1-848d-9b013c816aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1729195039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc960f52fada41f193debeb483542603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:56Z,use_quota=True,user_id='76ab692b69dc4d53a72ed9c265c81183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d821e017-6591-4443-a06b-cfde76308bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d821e017-6591-4443-a06b-cfde76308bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ea260d-0105-4861-9dc0-cd08c4a4995b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ea260d-0105-4861-9dc0-cd08c4a4995b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda', 'volume_name': 'volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf8dc63-fdc4-4a1d-8663-eebc71b962ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf8dc63-fdc4-4a1d-8663-eebc71b962ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fc9955-032b-496f-97ec-00788561a08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Volume ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda', 'volume_size': 1} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1729195039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc960f52fada41f193debeb483542603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:10:56Z,use_quota=True,user_id='76ab692b69dc4d53a72ed9c265c81183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Creating volume ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:10:56 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:56 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda 1073741824 Sep 28 19:10:56 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:56 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35" returned: 0 in 0.559s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:56 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35 Sep 28 19:10:56 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:57 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b1d81b71-f4e7-46b6-8375-3860646d3e35" returned: 0 in 0.468s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-quobyte-b1d81b71-f4e7-46b6-8375-3860646d3e35" released by "delete_volume" :: held 1.124s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Created reservations ['4f09b279-692e-424d-ae18-4a67fe49ff6a', '100df0ce-447f-4a4b-8e6d-ca42f57096d5', '9b49f4ae-c2d4-4c1a-aa32-d267ffd12402', '5ab8c619-59ce-43e3-a379-c27c66264304'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:10:57 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda 1073741824" returned: 0 in 0.752s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:57 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda Sep 28 19:10:57 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:57 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:10:57 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:57 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.377s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:58 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:10:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Deleted volume successfully. Sep 28 19:10:58 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda" returned: 0 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:10:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:10:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2023ea47-292d-423b-83f7-cea2c510bd8d tempest-CinderUnicodeTest-1848763065 None] Lock "cinder-b1d81b71-f4e7-46b6-8375-3860646d3e35-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:10:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fc9955-032b-496f-97ec-00788561a08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917b7910-5651-44d0-9599-c3df11fe059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:10:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Volume volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda (ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda): created successfully Sep 28 19:10:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917b7910-5651-44d0-9599-c3df11fe059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:10:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Flow 'volume_create_manager' (f1d7ffc5-c7b6-44e0-90f1-6dc38d9c3366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:10:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e0e50059-315d-430a-9699-fa4e87b67cc3 tempest-VolumesTransfersV357Test-134643351 None] Created volume successfully. Sep 28 19:10:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Acquiring lock "cinder-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Lock "cinder-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Acquiring lock "cinder-quobyte-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:10:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Lock "cinder-quobyte-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:10:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa1564a-b66f-41a0-9a5a-2066aa04b715]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:10:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:10:59 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda Sep 28 19:10:59 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:10:59 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Sep 28 19:10:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda" returned: 0 in 0.556s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:10:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:00 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda Sep 28 19:11:00 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:00 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda" returned: 0 in 0.493s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Lock "cinder-quobyte-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda" released by "delete_volume" :: held 1.123s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:00 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Created reservations ['ddf6df3b-cfcf-495b-9d48-dd42ada560a0', 'd2077032-d88b-45b8-bec3-cdf3ff9e7ccd', '9e48985b-c469-42bb-b0f8-f03f2829925c', 'c1724817-bae7-4887-b5e0-482e90412b97'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:11:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:00 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:11:00 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:01 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.356s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:01 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:11:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Deleted volume successfully. Sep 28 19:11:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7818766f-bcf2-4a92-b766-e33c5e72ab7a tempest-VolumesTransfersV357Test-1543475700 None] Lock "cinder-ce1d3bef-ddab-4a3a-9d23-9ab8b3fafeda-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Flow 'volume_create_manager' (83422e2a-6680-4c4d-94f6-89548abd065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e637fe1c-1991-4c37-95d8-c8962508acb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e637fe1c-1991-4c37-95d8-c8962508acb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2011510766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10278e42-99ec-4316-b18f-9fd9eab810c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2b7b9334f847d88e99c981cedb95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:05Z,use_quota=True,user_id='5dd42a160cd341b787da3bb90517445d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83da5452-9fe5-41ec-ad3d-a775e4602107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83da5452-9fe5-41ec-ad3d-a775e4602107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2626294c-9262-447c-beb2-c3e39a0caa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2626294c-9262-447c-beb2-c3e39a0caa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10278e42-99ec-4316-b18f-9fd9eab810c6', 'volume_name': 'volume-10278e42-99ec-4316-b18f-9fd9eab810c6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058eae8a-b735-413b-aa1f-56ab45eb5e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058eae8a-b735-413b-aa1f-56ab45eb5e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6002a26-176c-4926-9d3c-aac021ead9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Volume 10278e42-99ec-4316-b18f-9fd9eab810c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10278e42-99ec-4316-b18f-9fd9eab810c6', 'volume_size': 1} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2011510766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10278e42-99ec-4316-b18f-9fd9eab810c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2b7b9334f847d88e99c981cedb95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:05Z,use_quota=True,user_id='5dd42a160cd341b787da3bb90517445d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Creating volume 10278e42-99ec-4316-b18f-9fd9eab810c6 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:11:05 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:11:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:05 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6 1073741824 Sep 28 19:11:05 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:06 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6 1073741824" returned: 0 in 0.656s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:06 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6 Sep 28 19:11:06 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:06 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6" returned: 0 in 0.393s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:11:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6002a26-176c-4926-9d3c-aac021ead9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10278e42-99ec-4316-b18f-9fd9eab810c6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4d228d-124f-4722-a391-eff97fb087b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:06 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Volume volume-10278e42-99ec-4316-b18f-9fd9eab810c6 (10278e42-99ec-4316-b18f-9fd9eab810c6): created successfully Sep 28 19:11:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4d228d-124f-4722-a391-eff97fb087b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Flow 'volume_create_manager' (83422e2a-6680-4c4d-94f6-89548abd065f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-53c426f2-077b-471c-b9e6-8c58f2f63d36 tempest-ProjectReaderTests-980883499 None] Created volume successfully. Sep 28 19:11:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Acquiring lock "cinder-10278e42-99ec-4316-b18f-9fd9eab810c6-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Lock "cinder-10278e42-99ec-4316-b18f-9fd9eab810c6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Acquiring lock "cinder-quobyte-10278e42-99ec-4316-b18f-9fd9eab810c6" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Lock "cinder-quobyte-10278e42-99ec-4316-b18f-9fd9eab810c6" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:08 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a101d44-893e-49f0-8244-268ab8336a16]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:08 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6 Sep 28 19:11:08 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:08 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6" returned: 0 in 0.546s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:08 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6 Sep 28 19:11:08 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:09 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-10278e42-99ec-4316-b18f-9fd9eab810c6" returned: 0 in 0.312s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Lock "cinder-quobyte-10278e42-99ec-4316-b18f-9fd9eab810c6" released by "delete_volume" :: held 0.978s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Created reservations ['1576ef66-4494-4276-a125-af76722c7f10', '9040ae87-b01d-404d-9b11-1aeeba7f3d1f', '5f5bfcc2-68f2-41a5-9661-46b33c09553c', '91a78e3c-0f04-4bc5-9c75-127557c99d63'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:09 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:11:09 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:09 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.367s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:11:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Deleted volume successfully. Sep 28 19:11:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec590cfa-dc2e-4c52-8877-8e180bbd1a58 tempest-ProjectReaderTests-980883499 None] Lock "cinder-10278e42-99ec-4316-b18f-9fd9eab810c6-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Flow 'volume_create_manager' (d95422ac-854c-4564-8f09-3c051130e257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a839559-a935-48d9-97f6-4b071839296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a839559-a935-48d9-97f6-4b071839296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797605835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d221671-6f34-466c-9e2b-44d214c96659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2b7b9334f847d88e99c981cedb95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:11Z,use_quota=True,user_id='5dd42a160cd341b787da3bb90517445d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbd3452-440a-41a8-855c-a1bb0bea195f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbd3452-440a-41a8-855c-a1bb0bea195f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323d3cc1-4c3b-430b-9eef-16e8408596b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323d3cc1-4c3b-430b-9eef-16e8408596b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d221671-6f34-466c-9e2b-44d214c96659', 'volume_name': 'volume-3d221671-6f34-466c-9e2b-44d214c96659', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046c6d3d-2858-490f-ae59-6120319c388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046c6d3d-2858-490f-ae59-6120319c388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123f262c-beb3-4049-828b-5a282ff6d05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Volume 3d221671-6f34-466c-9e2b-44d214c96659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d221671-6f34-466c-9e2b-44d214c96659', 'volume_size': 1} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797605835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d221671-6f34-466c-9e2b-44d214c96659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2b7b9334f847d88e99c981cedb95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:11Z,use_quota=True,user_id='5dd42a160cd341b787da3bb90517445d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Creating volume 3d221671-6f34-466c-9e2b-44d214c96659 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:11:11 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:11 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659 1073741824 Sep 28 19:11:11 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Flow 'volume_create_manager' (f1f9a97d-1e8d-42fe-814e-e5e14c4f08f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe4ab1b-04b0-41cf-a994-1fa2d886dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe4ab1b-04b0-41cf-a994-1fa2d886dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1672188111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0e8d52-94d8-49e4-abd2-b728e07db214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81938da115f42848c5cc5744a202d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:12Z,use_quota=True,user_id='17939cc4c1204adc97f1018078025c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d7bf4b-c6fa-48b3-81ff-0d4decfb91d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d7bf4b-c6fa-48b3-81ff-0d4decfb91d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d91891-50e1-44e0-917a-2570f80d6836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d91891-50e1-44e0-917a-2570f80d6836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e0e8d52-94d8-49e4-abd2-b728e07db214', 'volume_name': 'volume-4e0e8d52-94d8-49e4-abd2-b728e07db214', 'volume_size': 2}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96f3878-de9f-445b-a24d-2e7005a86c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96f3878-de9f-445b-a24d-2e7005a86c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3133be3d-aebd-4540-bbb7-48e4423b7cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Volume 4e0e8d52-94d8-49e4-abd2-b728e07db214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e0e8d52-94d8-49e4-abd2-b728e07db214', 'volume_size': 2} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:12 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659 1073741824" returned: 0 in 0.717s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:12 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659 Sep 28 19:11:12 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:12 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659" returned: 0 in 0.479s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1672188111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0e8d52-94d8-49e4-abd2-b728e07db214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81938da115f42848c5cc5744a202d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:12Z,use_quota=True,user_id='17939cc4c1204adc97f1018078025c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Creating volume 4e0e8d52-94d8-49e4-abd2-b728e07db214 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:11:12 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214 2147483648 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:12 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214 2147483648 Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123f262c-beb3-4049-828b-5a282ff6d05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d221671-6f34-466c-9e2b-44d214c96659', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:12 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47afd5b-25ad-4b93-a851-4447962f06af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Flow 'volume_create_manager' (ac4a5d92-00a6-4613-9a2c-8b7f0ca289a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7ee391-0e73-4691-9eb5-21a650f9b09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Volume volume-3d221671-6f34-466c-9e2b-44d214c96659 (3d221671-6f34-466c-9e2b-44d214c96659): created successfully Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47afd5b-25ad-4b93-a851-4447962f06af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Flow 'volume_create_manager' (d95422ac-854c-4564-8f09-3c051130e257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7ee391-0e73-4691-9eb5-21a650f9b09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-487647340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b96ebe-820e-490d-ae7c-7ae869faa5c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609bf4c760304816ab28fc6fd505fd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:13Z,use_quota=True,user_id='b88ad40501414685a3ebc1913fe73186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42ce74b-ca0e-4021-9357-82a1f376aaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42ce74b-ca0e-4021-9357-82a1f376aaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3b441b-3758-4d1f-8a89-fefad807cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3b441b-3758-4d1f-8a89-fefad807cba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b96ebe-820e-490d-ae7c-7ae869faa5c8', 'volume_name': 'volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef5816e-826c-4124-8e0f-336530801a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef5816e-826c-4124-8e0f-336530801a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5471b5-03d3-4b91-98f3-7121348db26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Volume 65b96ebe-820e-490d-ae7c-7ae869faa5c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8', 'volume_size': 1} Sep 28 19:11:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a9785d4b-eeb2-4889-b8cc-56c747109cdc tempest-ProjectReaderTests-980883499 None] Created volume successfully. Sep 28 19:11:13 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214 2147483648" returned: 0 in 0.819s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Acquiring lock "cinder-3d221671-6f34-466c-9e2b-44d214c96659-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Lock "cinder-3d221671-6f34-466c-9e2b-44d214c96659-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:13 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214 Sep 28 19:11:13 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Acquiring lock "cinder-quobyte-3d221671-6f34-466c-9e2b-44d214c96659" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Lock "cinder-quobyte-3d221671-6f34-466c-9e2b-44d214c96659" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a653ef2f-3292-4a0a-b5d5-29be10961d50]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:13 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:13 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659 Sep 28 19:11:13 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214" returned: 0 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.107s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-487647340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b96ebe-820e-490d-ae7c-7ae869faa5c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609bf4c760304816ab28fc6fd505fd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:13Z,use_quota=True,user_id='b88ad40501414685a3ebc1913fe73186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Creating volume 65b96ebe-820e-490d-ae7c-7ae869faa5c8 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:11:13 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:11:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3133be3d-aebd-4540-bbb7-48e4423b7cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e0e8d52-94d8-49e4-abd2-b728e07db214', 'volume_size': 2}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:14 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8 1073741824 Sep 28 19:11:14 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753f0f71-f1f8-4dba-8a7b-7b6612e4681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Volume volume-4e0e8d52-94d8-49e4-abd2-b728e07db214 (4e0e8d52-94d8-49e4-abd2-b728e07db214): created successfully Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753f0f71-f1f8-4dba-8a7b-7b6612e4681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Flow 'volume_create_manager' (f1f9a97d-1e8d-42fe-814e-e5e14c4f08f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c50e2b44-16fe-4eff-af26-06dc540229a2 tempest-VolumesCloneNegativeTest-727620190 None] Created volume successfully. Sep 28 19:11:14 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659" returned: 0 in 0.639s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:14 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659 Sep 28 19:11:14 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:14 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8 1073741824" returned: 0 in 0.782s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:14 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3d221671-6f34-466c-9e2b-44d214c96659" returned: 0 in 0.389s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Lock "cinder-quobyte-3d221671-6f34-466c-9e2b-44d214c96659" released by "delete_volume" :: held 1.114s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:14 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8 Sep 28 19:11:14 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:14 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Created reservations ['08ae1117-4cad-42e6-97e8-fb5498c76662', '0e5840f8-cebb-4ff4-bdfd-0f17de0b2304', 'd8b04b8e-d8ef-48e3-8934-e05669e6b60a', '95176b80-ccf3-42c8-a795-0df3ac172401'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:15 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:11:15 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:15 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8" returned: 0 in 0.427s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5471b5-03d3-4b91-98f3-7121348db26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f1dc5e-de71-47ba-8f2a-f49c7c92524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Volume volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8 (65b96ebe-820e-490d-ae7c-7ae869faa5c8): created successfully Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f1dc5e-de71-47ba-8f2a-f49c7c92524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Flow 'volume_create_manager' (ac4a5d92-00a6-4613-9a2c-8b7f0ca289a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f07d09d5-5a34-4286-9266-5cb9aeca425e tempest-AttachVolumeNegativeTest-969719363 None] Created volume successfully. Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Acquiring lock "cinder-4e0e8d52-94d8-49e4-abd2-b728e07db214-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Lock "cinder-4e0e8d52-94d8-49e4-abd2-b728e07db214-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Acquiring lock "cinder-quobyte-4e0e8d52-94d8-49e4-abd2-b728e07db214" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Lock "cinder-quobyte-4e0e8d52-94d8-49e4-abd2-b728e07db214" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a6a8d-1d9a-4bf4-9fa7-4da376ddddea]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:15 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.513s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:11:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Deleted volume successfully. Sep 28 19:11:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7eac40ff-88c3-4960-9df3-59b69e694e57 tempest-ProjectReaderTests-980883499 None] Lock "cinder-3d221671-6f34-466c-9e2b-44d214c96659-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:15 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214 Sep 28 19:11:15 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:16 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214" returned: 0 in 0.595s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:16 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214 Sep 28 19:11:16 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:16 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e0e8d52-94d8-49e4-abd2-b728e07db214" returned: 0 in 0.531s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Lock "cinder-quobyte-4e0e8d52-94d8-49e4-abd2-b728e07db214" released by "delete_volume" :: held 1.213s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:16 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Created reservations ['ba466ce5-d91a-480b-b420-0dffef1daf64', 'f09ad522-d595-4010-8a54-aef9959b1760', '861a60b5-3421-4c86-b1e8-b805712f384f', '965f02e1-3b05-4a28-a966-5c7ada3f14b0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:17 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:11:17 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-c806349c-2c1c-4b9b-bac5-ea2b7ab41906 req-ffaeaa3b-9388-418c-9381-320312d6372c tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-c806349c-2c1c-4b9b-bac5-ea2b7ab41906 req-ffaeaa3b-9388-418c-9381-320312d6372c tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-c806349c-2c1c-4b9b-bac5-ea2b7ab41906 req-ffaeaa3b-9388-418c-9381-320312d6372c tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-c806349c-2c1c-4b9b-bac5-ea2b7ab41906 req-ffaeaa3b-9388-418c-9381-320312d6372c tempest-AttachVolumeNegativeTest-969719363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40a952cd-02e5-4748-9c0a-057d080c502c', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:11:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-c806349c-2c1c-4b9b-bac5-ea2b7ab41906 req-ffaeaa3b-9388-418c-9381-320312d6372c tempest-AttachVolumeNegativeTest-969719363 None] attachment_update completed successfully. Sep 28 19:11:17 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.357s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:11:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Deleted volume successfully. Sep 28 19:11:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a7b9536-ba51-46b2-9e5a-34c7f34f6238 tempest-VolumesCloneNegativeTest-727620190 None] Lock "cinder-4e0e8d52-94d8-49e4-abd2-b728e07db214-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Flow 'volume_create_manager' (bb416025-bbd0-40b4-80d3-a3c4482b9d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14f1e92-6f6a-461a-a1b1-07d272ee437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14f1e92-6f6a-461a-a1b1-07d272ee437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1304182220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a267c4-c629-4a3d-8ab9-ac070aa6c5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71dd8014210453c9d9eede0b2027bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:19Z,use_quota=True,user_id='1c565d3c7f7f4636b9e8af22b77c7596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ccde39-0714-4d38-a246-ba3f9e2f89be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ccde39-0714-4d38-a246-ba3f9e2f89be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bc26e0-2c17-406b-8703-d8496d515a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bc26e0-2c17-406b-8703-d8496d515a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a267c4-c629-4a3d-8ab9-ac070aa6c5dd', 'volume_name': 'volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6be0057-31c3-4bc6-9224-320dd788ec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6be0057-31c3-4bc6-9224-320dd788ec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de623f76-6195-4ce3-8cd9-6634c43b5d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:18 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Volume 79a267c4-c629-4a3d-8ab9-ac070aa6c5dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd', 'volume_size': 1} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1304182220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a267c4-c629-4a3d-8ab9-ac070aa6c5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71dd8014210453c9d9eede0b2027bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:19Z,use_quota=True,user_id='1c565d3c7f7f4636b9e8af22b77c7596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Creating volume 79a267c4-c629-4a3d-8ab9-ac070aa6c5dd {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:11:18 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:11:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:18 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd 1073741824 Sep 28 19:11:18 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:19 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd 1073741824" returned: 0 in 0.719s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:19 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd Sep 28 19:11:19 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:20 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:11:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de623f76-6195-4ce3-8cd9-6634c43b5d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59f2428-c8fe-4a78-9698-3931468f601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:20 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Volume volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd (79a267c4-c629-4a3d-8ab9-ac070aa6c5dd): created successfully Sep 28 19:11:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59f2428-c8fe-4a78-9698-3931468f601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Flow 'volume_create_manager' (bb416025-bbd0-40b4-80d3-a3c4482b9d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3468d369-aa83-4f2f-a15e-4bf29c2c2d19 tempest-TestImageHashVerification-1223531391 None] Created volume successfully. Sep 28 19:11:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-33188d45-a9d4-4cbb-937c-6755ac97df00 req-e3d335de-ae44-4c78-8033-3d70dd7ebb77 tempest-AttachVolumeNegativeTest-969719363 None] Terminate volume connection completed successfully. Sep 28 19:11:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-33188d45-a9d4-4cbb-937c-6755ac97df00 req-e3d335de-ae44-4c78-8033-3d70dd7ebb77 tempest-AttachVolumeNegativeTest-969719363 None] Deleting attachment 40a952cd-02e5-4748-9c0a-057d080c502c. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:11:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:22 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[970c16f5-06e1-4db4-94d8-bf3c0cf55727]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:22 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd Sep 28 19:11:22 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:23 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd" returned: 0 in 0.632s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92500b4-ecf9-4e2d-a012-56c96ece6853]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:23 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd Sep 28 19:11:23 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:24 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd" returned: 0 in 0.924s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd /opt/stack/data/cinder/conversion/79a267c4-c629-4a3d-8ab9-ac070aa6c5dd.temp_image.5f6543b1-245f-41de-9791-aa8635a2f73f1cqu4lk8.img {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:24 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd /opt/stack/data/cinder/conversion/79a267c4-c629-4a3d-8ab9-ac070aa6c5dd.temp_image.5f6543b1-245f-41de-9791-aa8635a2f73f1cqu4lk8.img Sep 28 19:11:24 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "cinder-65b96ebe-820e-490d-ae7c-7ae869faa5c8-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-65b96ebe-820e-490d-ae7c-7ae869faa5c8-delete_volume" acquired by "delete_volume" :: waited 0.223s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "cinder-quobyte-65b96ebe-820e-490d-ae7c-7ae869faa5c8" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-quobyte-65b96ebe-820e-490d-ae7c-7ae869faa5c8" acquired by "delete_volume" :: waited 0.053s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e33192b-81ff-4adc-a28e-214519134537]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:31 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8 Sep 28 19:11:31 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:32 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8" returned: 0 in 0.780s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:32 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8 Sep 28 19:11:32 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:32 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-65b96ebe-820e-490d-ae7c-7ae869faa5c8" returned: 0 in 0.524s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-quobyte-65b96ebe-820e-490d-ae7c-7ae869faa5c8" released by "delete_volume" :: held 1.453s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:33 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Created reservations ['970fd731-41dc-4ca3-8b84-de265ce55d92', 'f2a597e2-6d7d-41e6-8139-2f10b8d2081c', 'a19700f5-2278-4a7b-b448-dbb70ec8f06b', '7d8572c5-af4c-4e12-a7cc-2d33ab1f01c6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:11:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:33 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:11:33 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:33 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.587s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:33 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:11:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Deleted volume successfully. Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a055c5d3-2299-417e-a9c8-f95c038c4a77 tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-65b96ebe-820e-490d-ae7c-7ae869faa5c8-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "cinder-97a25b76-6a8d-40f8-a05f-27ead0b74865-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:34 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd /opt/stack/data/cinder/conversion/79a267c4-c629-4a3d-8ab9-ac070aa6c5dd.temp_image.5f6543b1-245f-41de-9791-aa8635a2f73f1cqu4lk8.img" returned: 0 in 10.061s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-97a25b76-6a8d-40f8-a05f-27ead0b74865-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8a3276-d193-4d09-9c3f-db892fd854a6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "cinder-quobyte-97a25b76-6a8d-40f8-a05f-27ead0b74865" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-quobyte-97a25b76-6a8d-40f8-a05f-27ead0b74865" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c76ac98-2f38-4fbf-816c-2491ca5a0823]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:34 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd Sep 28 19:11:34 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:34 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865 Sep 28 19:11:34 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:34 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:11:34 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:34 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd" returned: 0 in 0.755s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd, size 1024.00 MB, duration 10.06 sec, destination /opt/stack/data/cinder/conversion/79a267c4-c629-4a3d-8ab9-ac070aa6c5dd.temp_image.5f6543b1-245f-41de-9791-aa8635a2f73f1cqu4lk8.img {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:11:34 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Converted 1024.00 MB image at 101.74 MB/s Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] 5f6543b1-245f-41de-9791-aa8635a2f73f was raw, no need to convert to raw {{(pid=86846) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 19:11:34 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865" returned: 0 in 0.692s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:34 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865 Sep 28 19:11:34 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:35 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.495s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:11:35 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97a25b76-6a8d-40f8-a05f-27ead0b74865" returned: 0 in 0.605s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-quobyte-97a25b76-6a8d-40f8-a05f-27ead0b74865" released by "delete_volume" :: held 1.387s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Flow 'volume_create_manager' (d2bd8e91-0229-4bbb-a9e5-6845e6bd78c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623044c6-1c0c-47c8-b32a-f62c73e9f558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623044c6-1c0c-47c8-b32a-f62c73e9f558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1173322815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e273df42-15c0-4c3c-a0a9-f39d826388bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d281fd2cae942319ecea8e497a0a613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:35Z,use_quota=True,user_id='e89f3ea7cb45484baa8a929511ea7fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a577115f-e618-4461-b110-36023c22bb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a577115f-e618-4461-b110-36023c22bb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a2869b-499d-461f-862f-9e5565aa2a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a2869b-499d-461f-862f-9e5565aa2a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e273df42-15c0-4c3c-a0a9-f39d826388bb', 'volume_name': 'volume-e273df42-15c0-4c3c-a0a9-f39d826388bb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f2a082-bc6f-4839-a13c-d6f6012ee40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f2a082-bc6f-4839-a13c-d6f6012ee40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483443f1-9a14-4927-9f06-fb6ad8221255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Volume e273df42-15c0-4c3c-a0a9-f39d826388bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e273df42-15c0-4c3c-a0a9-f39d826388bb', 'volume_size': 1} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Created reservations ['1841f6e2-9a90-4952-b1fe-0bd2a5531f26', '59f66f18-becf-4c58-8a72-d7761873ed6b', 'a1bf2997-1c11-48af-9921-48ca74617fc1', '3aa948cc-0b6c-4f81-acd2-831fc72235e4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:35 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:11:35 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:36 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:36 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:11:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Deleted volume successfully. Sep 28 19:11:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e399da1-6982-4edd-933e-231ee0f7562a tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-97a25b76-6a8d-40f8-a05f-27ead0b74865-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "cinder-5ecdcb6a-120d-4f07-bfcc-e604f87d9876-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-5ecdcb6a-120d-4f07-bfcc-e604f87d9876-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "cinder-quobyte-5ecdcb6a-120d-4f07-bfcc-e604f87d9876" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-quobyte-5ecdcb6a-120d-4f07-bfcc-e604f87d9876" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d513e70-78bf-4b11-bccb-783ca6aa2526]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:37 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876 Sep 28 19:11:37 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:37 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876" returned: 0 in 0.539s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:37 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876 Sep 28 19:11:37 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:37 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5ecdcb6a-120d-4f07-bfcc-e604f87d9876" returned: 0 in 0.411s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-quobyte-5ecdcb6a-120d-4f07-bfcc-e604f87d9876" released by "delete_volume" :: held 1.046s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Created reservations ['1e6c09d2-d126-449b-bde2-a969d70b2ea4', '5b2b1845-8bb3-4652-be5d-8084f07e7b8e', '707b206a-386c-4f2f-bb64-589be112fbc2', '8ee99e23-062e-4377-b2fd-46de9ae18417'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:11:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:38 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:11:38 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:38 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.303s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:38 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:11:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Deleted volume successfully. Sep 28 19:11:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e120258a-2b98-4e00-aeb2-68f4675c9beb tempest-AttachVolumeNegativeTest-969719363 None] Lock "cinder-5ecdcb6a-120d-4f07-bfcc-e604f87d9876-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=97,cinder:INSERT=25,cinder:UPDATE=106,cinder:DELETE=10 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=127,cinder:DELETE=10,cinder:SELECT=79,cinder:INSERT=29 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Flow 'volume_create_manager' (70f43adb-a9db-4145-a4b7-f4bab549eda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfda047-379b-430c-ba05-56ef27cacec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfda047-379b-430c-ba05-56ef27cacec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-640694748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe47224-e314-4ec0-a184-a0ff78d89d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd5ac18aee04511a869908b76c4212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:43Z,use_quota=True,user_id='a0b8a89a393648568d0553efc670d43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2cbd3c-e454-45b6-a89b-5d1cca285a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2cbd3c-e454-45b6-a89b-5d1cca285a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f17047-fad5-4d89-8f6a-6aabc7699dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f17047-fad5-4d89-8f6a-6aabc7699dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe47224-e314-4ec0-a184-a0ff78d89d35', 'volume_name': 'volume-1fe47224-e314-4ec0-a184-a0ff78d89d35', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c82dba-4e1f-420d-b50c-0e2b8099c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c82dba-4e1f-420d-b50c-0e2b8099c186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170cbc14-6d0f-4833-88f0-cf4d6d255f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Volume 1fe47224-e314-4ec0-a184-a0ff78d89d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe47224-e314-4ec0-a184-a0ff78d89d35', 'volume_size': 1} Sep 28 19:11:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Flow 'volume_create_manager' (b4fae0c1-9482-4aa4-b520-7e4167518258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5e0e86-97c2-4a5a-b43c-21a234cfa801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5e0e86-97c2-4a5a-b43c-21a234cfa801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-209827354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b08680-7421-490f-aabf-3ec7f9ecb54e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d73e9ae360e47aaaab7255575cb969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:52Z,use_quota=True,user_id='df9128ae444b4ab6968c84c2f0ef009c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faa71e3-a594-4f8a-9333-737b3d3a7ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faa71e3-a594-4f8a-9333-737b3d3a7ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4576ac-57bc-4232-a188-6c3593748b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4576ac-57bc-4232-a188-6c3593748b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b08680-7421-490f-aabf-3ec7f9ecb54e', 'volume_name': 'volume-81b08680-7421-490f-aabf-3ec7f9ecb54e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a1ac92-c217-4d21-b0f7-3d989f31ec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a1ac92-c217-4d21-b0f7-3d989f31ec43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd2f925-3553-4afe-83bd-7353e30fb8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:52 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Volume 81b08680-7421-490f-aabf-3ec7f9ecb54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b08680-7421-490f-aabf-3ec7f9ecb54e', 'volume_size': 1} Sep 28 19:11:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.546s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Uploaded volume to glance image-id: 5f6543b1-245f-41de-9791-aa8635a2f73f. {{(pid=86846) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.235s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1173322815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e273df42-15c0-4c3c-a0a9-f39d826388bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d281fd2cae942319ecea8e497a0a613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:35Z,use_quota=True,user_id='e89f3ea7cb45484baa8a929511ea7fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Creating volume e273df42-15c0-4c3c-a0a9-f39d826388bb {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:11:57 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:11:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:57 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb 1073741824 Sep 28 19:11:57 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a23a2555-061a-4a3a-96e3-712a9f03ee9b tempest-TestImageHashVerification-1223531391 None] Copy volume to image completed successfully. Sep 28 19:11:58 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb 1073741824" returned: 0 in 0.436s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:58 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb Sep 28 19:11:58 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:58 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb" returned: 0 in 0.263s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.975s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-640694748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe47224-e314-4ec0-a184-a0ff78d89d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd5ac18aee04511a869908b76c4212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:43Z,use_quota=True,user_id='a0b8a89a393648568d0553efc670d43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Creating volume 1fe47224-e314-4ec0-a184-a0ff78d89d35 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:11:58 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:58 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 1073741824 Sep 28 19:11:58 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483443f1-9a14-4927-9f06-fb6ad8221255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e273df42-15c0-4c3c-a0a9-f39d826388bb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4947ae0-5767-487e-b151-3b2bf4ed8e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Volume volume-e273df42-15c0-4c3c-a0a9-f39d826388bb (e273df42-15c0-4c3c-a0a9-f39d826388bb): created successfully Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4947ae0-5767-487e-b151-3b2bf4ed8e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Flow 'volume_create_manager' (d2bd8e91-0229-4bbb-a9e5-6845e6bd78c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-add21c55-824c-4edc-8473-bde6da77e61d tempest-ProjectReaderTests-1371965929 None] Created volume successfully. Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Acquiring lock "cinder-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Lock "cinder-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Acquiring lock "cinder-quobyte-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Lock "cinder-quobyte-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9839b554-8812-464d-880a-121933ad133d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:59 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd Sep 28 19:11:59 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:59 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 1073741824" returned: 0 in 0.538s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:59 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 Sep 28 19:11:59 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:59 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd" returned: 0 in 0.427s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Acquiring lock "cinder-e273df42-15c0-4c3c-a0a9-f39d826388bb-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:59 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd Sep 28 19:11:59 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Lock "cinder-e273df42-15c0-4c3c-a0a9-f39d826388bb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Acquiring lock "cinder-quobyte-e273df42-15c0-4c3c-a0a9-f39d826388bb" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Lock "cinder-quobyte-e273df42-15c0-4c3c-a0a9-f39d826388bb" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:11:59 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.259s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-209827354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b08680-7421-490f-aabf-3ec7f9ecb54e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d73e9ae360e47aaaab7255575cb969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:11:52Z,use_quota=True,user_id='df9128ae444b4ab6968c84c2f0ef009c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Creating volume 81b08680-7421-490f-aabf-3ec7f9ecb54e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:11:59 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de67e84-e924-4a4b-a941-e03ea22c3be2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:59 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e 1073741824 Sep 28 19:11:59 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170cbc14-6d0f-4833-88f0-cf4d6d255f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe47224-e314-4ec0-a184-a0ff78d89d35', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e915f3dc-fd19-4eba-be27-8929d2534f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:11:59 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Volume volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 (1fe47224-e314-4ec0-a184-a0ff78d89d35): created successfully Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e915f3dc-fd19-4eba-be27-8929d2534f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Flow 'volume_create_manager' (70f43adb-a9db-4145-a4b7-f4bab549eda3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:11:59 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:11:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0504fe1c-fb31-423c-bdf9-e9d882fec857 tempest-VolumesSnapshotTestJSON-481411320 None] Created volume successfully. Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Lock "cinder-quobyte-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd" released by "delete_volume" :: held 0.776s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:11:59 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb Sep 28 19:11:59 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Created reservations ['4353a566-982d-4422-826e-f63511ce8eda', 'c86256b7-d952-46c5-b1c6-e00f3520e850', '90bc53bc-0f5e-43af-9978-ba4b4d00e3b9', 'dac016dc-2847-494f-aa59-8799905e4d2a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:11:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:11:59 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:11:59 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:00 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb" returned: 0 in 0.508s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:00 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb Sep 28 19:12:00 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:00 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e 1073741824" returned: 0 in 0.679s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:00 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.420s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Deleted volume successfully. Sep 28 19:12:00 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e Sep 28 19:12:00 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ea450428-9ad6-48de-a8f1-71c15a1a9ee6 tempest-TestImageHashVerification-1223531391 None] Lock "cinder-79a267c4-c629-4a3d-8ab9-ac070aa6c5dd-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:00 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e273df42-15c0-4c3c-a0a9-f39d826388bb" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Lock "cinder-quobyte-e273df42-15c0-4c3c-a0a9-f39d826388bb" released by "delete_volume" :: held 0.922s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Created reservations ['901f56a0-1a40-4e6b-8a06-0ca8b0118305', '84b487a1-ad0b-4268-9eb3-fa4d96d5ec43', '91e15a9c-5a9d-4070-b3f8-d2f4ad262f6e', '1488e379-e887-4ee0-8f43-a3163666b6ba'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:00 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e" returned: 0 in 0.364s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd2f925-3553-4afe-83bd-7353e30fb8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b08680-7421-490f-aabf-3ec7f9ecb54e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93d5873-295e-4392-98f8-d3bc533ce4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:00 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:00 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Volume volume-81b08680-7421-490f-aabf-3ec7f9ecb54e (81b08680-7421-490f-aabf-3ec7f9ecb54e): created successfully Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93d5873-295e-4392-98f8-d3bc533ce4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Flow 'volume_create_manager' (b4fae0c1-9482-4aa4-b520-7e4167518258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e1ee0585-0716-4338-a9a0-c38fd2b54b3c tempest-VolumesTestJSON-1073508150 None] Created volume successfully. Sep 28 19:12:01 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:01 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Deleted volume successfully. Sep 28 19:12:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27a6358c-2d81-4d17-90b4-59e65ed1f0dd tempest-ProjectReaderTests-1371965929 None] Lock "cinder-e273df42-15c0-4c3c-a0a9-f39d826388bb-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Creating offline snapshot 61aa8375-3f54-4e19-8110-7459869badb9 of volume 1fe47224-e314-4ec0-a184-a0ff78d89d35 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:12:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2120c4-b021-492c-9738-bbadbdacdbcc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:01 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 Sep 28 19:12:01 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:01 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35" returned: 0 in 0.457s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:01 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 1G Sep 28 19:12:01 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:02 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 1G" returned: 0 in 0.744s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:02 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 Sep 28 19:12:02 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Flow 'volume_create_manager' (697a0652-6441-404a-b22d-eb46d1a5626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2cc1b4-8220-4bf4-bb99-d4eaa67b085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2cc1b4-8220-4bf4-bb99-d4eaa67b085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247477292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd4f8ee-8780-4c5b-bb48-d4f21476f67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d281fd2cae942319ecea8e497a0a613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:03Z,use_quota=True,user_id='e89f3ea7cb45484baa8a929511ea7fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307ba17a-b62c-45dc-843a-d2a8e1a905cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307ba17a-b62c-45dc-843a-d2a8e1a905cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc486c7a-a92e-47a8-a8ae-80b826ba12b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc486c7a-a92e-47a8-a8ae-80b826ba12b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd4f8ee-8780-4c5b-bb48-d4f21476f67d', 'volume_name': 'volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa7f320-d142-4be0-9d1e-0c1a9801f22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa7f320-d142-4be0-9d1e-0c1a9801f22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6b468c-0612-44e8-9014-d91e533eb758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Volume bcd4f8ee-8780-4c5b-bb48-d4f21476f67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d', 'volume_size': 1} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Flow 'volume_create_manager' (746f3a8d-6790-4903-b314-4ccfcd98102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece22814-6d1b-46ca-b78d-1f7a5685bbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece22814-6d1b-46ca-b78d-1f7a5685bbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-975949419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0a90fd-4508-4a48-8e43-053b4bd20cf7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d73e9ae360e47aaaab7255575cb969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:03Z,use_quota=True,user_id='df9128ae444b4ab6968c84c2f0ef009c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44362afe-de5e-4590-b006-ad4360a49dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44362afe-de5e-4590-b006-ad4360a49dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7069f20f-b40e-4907-a29b-6978948bfcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7069f20f-b40e-4907-a29b-6978948bfcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0a90fd-4508-4a48-8e43-053b4bd20cf7', 'volume_name': 'volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9744f79a-e5ff-4ebd-acac-eee0806d8f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9744f79a-e5ff-4ebd-acac-eee0806d8f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7638b68c-4b5b-4625-9cae-9ed75c67436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Volume fe0a90fd-4508-4a48-8e43-053b4bd20cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7', 'volume_size': 1} Sep 28 19:12:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:03 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9" returned: 0 in 0.380s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:03 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 is being set with open permissions: ugo+rw Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:03 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 Sep 28 19:12:03 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:03 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9" returned: 0 in 0.277s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:03 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.info Sep 28 19:12:03 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:03 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.info" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:03 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.info is being set with open permissions: ugo+rw Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:03 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.info Sep 28 19:12:03 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:03 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.info" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.150s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247477292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd4f8ee-8780-4c5b-bb48-d4f21476f67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d281fd2cae942319ecea8e497a0a613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:03Z,use_quota=True,user_id='e89f3ea7cb45484baa8a929511ea7fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Creating volume bcd4f8ee-8780-4c5b-bb48-d4f21476f67d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:03 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:12:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:03 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d 1073741824 Sep 28 19:12:03 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f43495ea-05e4-4098-b44c-e8d674d12259 tempest-VolumesSnapshotTestJSON-481411320 None] Create snapshot completed successfully Sep 28 19:12:04 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d 1073741824" returned: 0 in 0.580s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:04 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d Sep 28 19:12:04 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-61aa8375-3f54-4e19-8110-7459869badb9-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-61aa8375-3f54-4e19-8110-7459869badb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-1fe47224-e314-4ec0-a184-a0ff78d89d35" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-1fe47224-e314-4ec0-a184-a0ff78d89d35" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-61aa8375-3f54-4e19-8110-7459869badb9" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:04 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-61aa8375-3f54-4e19-8110-7459869badb9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Deleting offline snapshot 61aa8375-3f54-4e19-8110-7459869badb9 of volume 1fe47224-e314-4ec0-a184-a0ff78d89d35 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] snapshot_file for this snap is: volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d" returned: 0 in 0.378s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-975949419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0a90fd-4508-4a48-8e43-053b4bd20cf7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d73e9ae360e47aaaab7255575cb969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:03Z,use_quota=True,user_id='df9128ae444b4ab6968c84c2f0ef009c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Creating volume fe0a90fd-4508-4a48-8e43-053b4bd20cf7 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:04 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[917f5f24-601c-4fa4-928a-8d17addce830]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:04 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7 1073741824 Sep 28 19:12:04 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6b468c-0612-44e8-9014-d91e533eb758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb10c019-917b-471d-89a7-68f9e993af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Volume volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d (bcd4f8ee-8780-4c5b-bb48-d4f21476f67d): created successfully Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb10c019-917b-471d-89a7-68f9e993af58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Flow 'volume_create_manager' (697a0652-6441-404a-b22d-eb46d1a5626a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bdfab0ac-1996-4547-9a6f-8d2f66bb2d92 tempest-ProjectReaderTests-1371965929 None] Created volume successfully. Sep 28 19:12:05 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 Sep 28 19:12:05 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:05 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9" returned: 0 in 0.482s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fe47224-e314-4ec0-a184-a0ff78d89d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d46c5f5-909d-40b8-ac85-1a468168fc54]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:05 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7 1073741824" returned: 0 in 0.589s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:05 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7 Sep 28 19:12:05 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:05 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 Sep 28 19:12:05 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Acquiring lock "cinder-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Lock "cinder-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:05 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7" returned: 0 in 0.362s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Acquiring lock "cinder-quobyte-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7638b68c-4b5b-4625-9cae-9ed75c67436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b06256-b2c9-415d-8a5a-4a611a444110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Lock "cinder-quobyte-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:06 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Volume volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7 (fe0a90fd-4508-4a48-8e43-053b4bd20cf7): created successfully Sep 28 19:12:06 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b06256-b2c9-415d-8a5a-4a611a444110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Flow 'volume_create_manager' (746f3a8d-6790-4903-b314-4ccfcd98102e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4783eeb9-6c0e-4826-a86b-f28656cded86]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35" returned: 0 in 0.556s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c0633241-8b51-485e-af39-b964cd86cfe9 tempest-VolumesTestJSON-1073508150 None] Created volume successfully. Sep 28 19:12:06 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 Sep 28 19:12:06 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:06 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d Sep 28 19:12:06 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:06 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d" returned: 0 in 0.479s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:06 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:06 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d Sep 28 19:12:06 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:06 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9 Sep 28 19:12:06 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:06 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d" returned: 0 in 0.316s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:06 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35.61aa8375-3f54-4e19-8110-7459869badb9" returned: 0 in 0.297s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Lock "cinder-quobyte-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d" released by "delete_volume" :: held 0.876s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-61aa8375-3f54-4e19-8110-7459869badb9" released by "_delete_snapshot" :: held 2.053s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-1fe47224-e314-4ec0-a184-a0ff78d89d35" released by "delete_snapshot" :: held 2.089s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Created reservations ['ecf82dfa-7b98-4059-ba49-88dffe42df52', '5763c3f2-101a-41e3-862c-0d6b37b19a3f', '15c7dda0-9162-451d-ad55-de196b9c6903', '4160a6a0-0477-4c1c-a969-466fb763f3e7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Created reservations ['04ef4eb1-b4e9-408a-aa6f-0ab65590edb8', '63921847-ce37-4cbb-a697-86c598ed324e', 'fa2b5981-7794-4e33-a558-683b1da4a120', '1dd90d2d-c32b-4e13-938a-86f88fcb0d8a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:07 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:07 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Delete snapshot completed successfully. Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82fc6529-4e06-4cbb-8e0b-33e87d5b14f3 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-61aa8375-3f54-4e19-8110-7459869badb9-delete_snapshot" released by "delete_snapshot" :: held 2.500s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:07 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.357s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Deleted volume successfully. Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9b4511b9-57db-42e3-9c7a-e30d9864cea5 tempest-ProjectReaderTests-1371965929 None] Lock "cinder-bcd4f8ee-8780-4c5b-bb48-d4f21476f67d-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Flow 'volume_create_manager' (63b09645-a938-4436-8c59-9ea702783139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9d5112-a712-4913-8bc4-e2094d2d38f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9d5112-a712-4913-8bc4-e2094d2d38f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2117299363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20772c5c-a6dd-4d22-b7a7-de20547489c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d73e9ae360e47aaaab7255575cb969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:08Z,use_quota=True,user_id='df9128ae444b4ab6968c84c2f0ef009c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31e95ee-15b8-4375-87a3-b07200312cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31e95ee-15b8-4375-87a3-b07200312cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a91b922-95e6-4453-ba81-ab7fdc436870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a91b922-95e6-4453-ba81-ab7fdc436870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20772c5c-a6dd-4d22-b7a7-de20547489c3', 'volume_name': 'volume-20772c5c-a6dd-4d22-b7a7-de20547489c3', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fc7d8d-b8c4-4990-a90b-1c427146d394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fc7d8d-b8c4-4990-a90b-1c427146d394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39b755b-79ff-4783-bb2d-efd71e557515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Volume 20772c5c-a6dd-4d22-b7a7-de20547489c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20772c5c-a6dd-4d22-b7a7-de20547489c3', 'volume_size': 1} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2117299363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20772c5c-a6dd-4d22-b7a7-de20547489c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d73e9ae360e47aaaab7255575cb969c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:08Z,use_quota=True,user_id='df9128ae444b4ab6968c84c2f0ef009c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Creating volume 20772c5c-a6dd-4d22-b7a7-de20547489c3 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:07 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:12:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:07 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3 1073741824 Sep 28 19:12:07 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:08 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3 1073741824" returned: 0 in 0.664s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:08 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3 Sep 28 19:12:08 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:09 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Flow 'volume_create_manager' (a5981fbc-bd84-4460-be31-6a704c82092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6324ffb-af76-4c74-bc79-e4eb18c46aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3" returned: 0 in 0.426s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6324ffb-af76-4c74-bc79-e4eb18c46aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1735846301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deb004d-92c1-4c09-a6c8-2afe0cf7f93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd5ac18aee04511a869908b76c4212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:09Z,use_quota=True,user_id='a0b8a89a393648568d0553efc670d43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4d88a1-4b2a-4a7d-9beb-c42f831d4e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4d88a1-4b2a-4a7d-9beb-c42f831d4e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003ae1ed-e21f-4cf9-aded-74d8ae820f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003ae1ed-e21f-4cf9-aded-74d8ae820f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0deb004d-92c1-4c09-a6c8-2afe0cf7f93f', 'volume_name': 'volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f98608-c9bb-4480-af0b-413c5821dc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f98608-c9bb-4480-af0b-413c5821dc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126b1d5e-be5b-48a0-b3bb-98f7e4a8cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Volume 0deb004d-92c1-4c09-a6c8-2afe0cf7f93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f', 'volume_size': 1} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1735846301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deb004d-92c1-4c09-a6c8-2afe0cf7f93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd5ac18aee04511a869908b76c4212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:09Z,use_quota=True,user_id='a0b8a89a393648568d0553efc670d43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Creating volume 0deb004d-92c1-4c09-a6c8-2afe0cf7f93f {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:09 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39b755b-79ff-4783-bb2d-efd71e557515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20772c5c-a6dd-4d22-b7a7-de20547489c3', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:09 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f 1073741824 Sep 28 19:12:09 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20c851f-72e4-45b6-ab59-d7db0ec81569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Flow 'volume_create_manager' (72ea9246-29f5-4719-9124-11c142420291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce80c5c-5edb-4cfd-862f-ceb975e407be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Volume volume-20772c5c-a6dd-4d22-b7a7-de20547489c3 (20772c5c-a6dd-4d22-b7a7-de20547489c3): created successfully Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20c851f-72e4-45b6-ab59-d7db0ec81569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Flow 'volume_create_manager' (63b09645-a938-4436-8c59-9ea702783139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce80c5c-5edb-4cfd-862f-ceb975e407be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-412327157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5ad851-7ba9-407c-adf0-6be3880d4bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d281fd2cae942319ecea8e497a0a613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:09Z,use_quota=True,user_id='e89f3ea7cb45484baa8a929511ea7fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de421a81-d3b0-4dd3-b98b-39857ed0672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de421a81-d3b0-4dd3-b98b-39857ed0672d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f36760-35bf-4f53-a27d-158e861d8f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f36760-35bf-4f53-a27d-158e861d8f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e5ad851-7ba9-407c-adf0-6be3880d4bf1', 'volume_name': 'volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb8e469-5622-42cc-8fbf-25f6e86023a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb8e469-5622-42cc-8fbf-25f6e86023a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a33b6c-e857-40f9-b632-c73e6ade17fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Volume 8e5ad851-7ba9-407c-adf0-6be3880d4bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1', 'volume_size': 1} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2f3323d1-5e5a-4f88-9faa-77dbc3a97ffc tempest-VolumesTestJSON-1073508150 None] Created volume successfully. Sep 28 19:12:09 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f 1073741824" returned: 0 in 0.667s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:09 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f Sep 28 19:12:09 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:10 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-412327157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5ad851-7ba9-407c-adf0-6be3880d4bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d281fd2cae942319ecea8e497a0a613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:09Z,use_quota=True,user_id='e89f3ea7cb45484baa8a929511ea7fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Creating volume 8e5ad851-7ba9-407c-adf0-6be3880d4bf1 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:10 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126b1d5e-be5b-48a0-b3bb-98f7e4a8cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:10 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1 1073741824 Sep 28 19:12:10 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4cbe2a-89d7-4e27-bb22-b6c32c79c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Volume volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f (0deb004d-92c1-4c09-a6c8-2afe0cf7f93f): created successfully Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4cbe2a-89d7-4e27-bb22-b6c32c79c97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Flow 'volume_create_manager' (a5981fbc-bd84-4460-be31-6a704c82092c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-050d30d4-1bb1-4b13-84d6-46a39acc8ba8 tempest-VolumesSnapshotTestJSON-481411320 None] Created volume successfully. Sep 28 19:12:11 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1 1073741824" returned: 0 in 0.722s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:11 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1 Sep 28 19:12:11 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Acquiring lock "cinder-20772c5c-a6dd-4d22-b7a7-de20547489c3-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Lock "cinder-20772c5c-a6dd-4d22-b7a7-de20547489c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Acquiring lock "cinder-quobyte-20772c5c-a6dd-4d22-b7a7-de20547489c3" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Lock "cinder-quobyte-20772c5c-a6dd-4d22-b7a7-de20547489c3" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:11 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1" returned: 0 in 0.378s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.277s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3be0ff-b804-444b-94d9-0c4ee41f6e9d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a33b6c-e857-40f9-b632-c73e6ade17fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2eac62e-e128-4f9c-9296-a0b439c74304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Creating offline snapshot ee9db169-5762-44e9-9842-e582dfc1d4e6 of volume 0deb004d-92c1-4c09-a6c8-2afe0cf7f93f {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:12:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Volume volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1 (8e5ad851-7ba9-407c-adf0-6be3880d4bf1): created successfully Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2eac62e-e128-4f9c-9296-a0b439c74304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Flow 'volume_create_manager' (72ea9246-29f5-4719-9124-11c142420291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b41f2f-4dde-438a-9931-9248da3ce0b1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e8e90cb0-12b8-4a33-b906-1351f488af3f tempest-ProjectReaderTests-1371965929 None] Created volume successfully. Sep 28 19:12:11 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3 Sep 28 19:12:11 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:11 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f Sep 28 19:12:11 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:12 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3" returned: 0 in 0.619s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:12 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3 Sep 28 19:12:12 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:12 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" returned: 0 in 0.583s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Acquiring lock "cinder-8e5ad851-7ba9-407c-adf0-6be3880d4bf1-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:12 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 1G Sep 28 19:12:12 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Lock "cinder-8e5ad851-7ba9-407c-adf0-6be3880d4bf1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Acquiring lock "cinder-quobyte-8e5ad851-7ba9-407c-adf0-6be3880d4bf1" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Lock "cinder-quobyte-8e5ad851-7ba9-407c-adf0-6be3880d4bf1" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef876ff1-668f-4534-a134-cbc45b83b243]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:12 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-20772c5c-a6dd-4d22-b7a7-de20547489c3" returned: 0 in 0.446s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Lock "cinder-quobyte-20772c5c-a6dd-4d22-b7a7-de20547489c3" released by "delete_volume" :: held 1.162s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:12 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1 Sep 28 19:12:12 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Created reservations ['56a708b7-4330-46b6-a2ea-8104791c9a0a', 'cf7c02a1-51a2-48e6-b3ec-fcb1d9673ef3', 'd91b6703-47e3-497c-ba48-5e9f053cbc2c', '81e7ad4d-e751-4f78-a71f-ee41541d1aef'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:12 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:12 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:12 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 1G" returned: 0 in 0.719s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:12 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:13 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 Sep 28 19:12:13 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:13 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1 Sep 28 19:12:13 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:13 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.390s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Deleted volume successfully. Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e53279fb-7387-4951-8b77-805ffce72e6e tempest-VolumesTestJSON-1073508150 None] Lock "cinder-20772c5c-a6dd-4d22-b7a7-de20547489c3-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:13 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:13 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 is being set with open permissions: ugo+rw Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:13 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 Sep 28 19:12:13 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:13 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8e5ad851-7ba9-407c-adf0-6be3880d4bf1" returned: 0 in 0.444s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Lock "cinder-quobyte-8e5ad851-7ba9-407c-adf0-6be3880d4bf1" released by "delete_volume" :: held 1.035s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Created reservations ['accfb579-6037-45ae-b979-e8595a723ce0', '4205e191-e8ca-462d-9e12-d47f35de103e', '5021300f-6920-4c66-9ec9-d9d6028424c8', '2bc727e6-205d-4715-9d07-27bb3a98c132'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Acquiring lock "cinder-fe0a90fd-4508-4a48-8e43-053b4bd20cf7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:13 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:13 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:13 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Lock "cinder-fe0a90fd-4508-4a48-8e43-053b4bd20cf7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Acquiring lock "cinder-quobyte-fe0a90fd-4508-4a48-8e43-053b4bd20cf7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:13 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.info Sep 28 19:12:13 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Lock "cinder-quobyte-fe0a90fd-4508-4a48-8e43-053b4bd20cf7" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d092b2-8f99-484c-9a48-b9d8dfc63d15]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:13 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.323s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Deleted volume successfully. Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c4db902-a6ce-42d4-8875-69c7fa7508fa tempest-ProjectReaderTests-1371965929 None] Lock "cinder-8e5ad851-7ba9-407c-adf0-6be3880d4bf1-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:14 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7 Sep 28 19:12:14 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:14 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.info" returned: 0 in 0.373s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:14 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.info is being set with open permissions: ugo+rw Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:14 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.info Sep 28 19:12:14 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:14 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7" returned: 0 in 0.500s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:14 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7 Sep 28 19:12:14 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:14 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.info" returned: 0 in 0.356s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.092s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fe160b9f-da96-4f89-9ff8-47f6f0cba9d9 tempest-VolumesSnapshotTestJSON-481411320 None] Create snapshot completed successfully Sep 28 19:12:14 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fe0a90fd-4508-4a48-8e43-053b4bd20cf7" returned: 0 in 0.324s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Lock "cinder-quobyte-fe0a90fd-4508-4a48-8e43-053b4bd20cf7" released by "delete_volume" :: held 0.887s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Created reservations ['a7c2954e-6ba8-48ba-a95c-383b611e9289', '730d5600-4767-464c-8a4b-35533db7b59b', '8a6596a3-486e-4f8d-8868-4e0055750fd1', 'b08e12e6-9334-4626-afea-ac8179881f57'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:14 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:14 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Flow 'volume_create_manager' (96743fa0-2b63-40ba-927e-eff86df7dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c31b52-2f2d-4be1-bae7-867cfbec48d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c31b52-2f2d-4be1-bae7-867cfbec48d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-807769316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182c73bf-f39b-4722-a7a4-14505514aebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d281fd2cae942319ecea8e497a0a613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:15Z,use_quota=True,user_id='e89f3ea7cb45484baa8a929511ea7fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413fbbfd-7738-4226-8b45-2a120ae8b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413fbbfd-7738-4226-8b45-2a120ae8b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143e74c4-ace4-4d45-8cc4-82b89fea313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143e74c4-ace4-4d45-8cc4-82b89fea313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182c73bf-f39b-4722-a7a4-14505514aebe', 'volume_name': 'volume-182c73bf-f39b-4722-a7a4-14505514aebe', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160979dd-ff6e-4bef-8b9e-3cd750db9b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160979dd-ff6e-4bef-8b9e-3cd750db9b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98576edd-c585-439c-bc5d-b1a1044e08e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Volume 182c73bf-f39b-4722-a7a4-14505514aebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182c73bf-f39b-4722-a7a4-14505514aebe', 'volume_size': 1} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-807769316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182c73bf-f39b-4722-a7a4-14505514aebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d281fd2cae942319ecea8e497a0a613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:15Z,use_quota=True,user_id='e89f3ea7cb45484baa8a929511ea7fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Creating volume 182c73bf-f39b-4722-a7a4-14505514aebe {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:15 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:15 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.429s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Deleted volume successfully. Sep 28 19:12:15 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe 1073741824 Sep 28 19:12:15 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a58e4a8-405d-4d91-9f6b-b4d9bf5ecc34 tempest-VolumesTestJSON-1073508150 None] Lock "cinder-fe0a90fd-4508-4a48-8e43-053b4bd20cf7-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Acquiring lock "cinder-81b08680-7421-490f-aabf-3ec7f9ecb54e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Lock "cinder-81b08680-7421-490f-aabf-3ec7f9ecb54e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:16 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe 1073741824" returned: 0 in 0.816s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Acquiring lock "cinder-quobyte-81b08680-7421-490f-aabf-3ec7f9ecb54e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Lock "cinder-quobyte-81b08680-7421-490f-aabf-3ec7f9ecb54e" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d6e2ee-81c9-4ab7-a8c8-4977733face7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:16 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe Sep 28 19:12:16 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:16 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e Sep 28 19:12:16 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Flow 'volume_create_manager' (1843b37c-9665-4606-a0bb-00e6dfe18b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbae1efa-766f-467f-88e1-588ea31dcdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbae1efa-766f-467f-88e1-588ea31dcdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-450408322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31d9651-5cd5-4187-84c2-3a42953ff1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd5ac18aee04511a869908b76c4212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ee9db169-5762-44e9-9842-e582dfc1d4e6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:16Z,use_quota=True,user_id='a0b8a89a393648568d0553efc670d43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e90ffa2-8ae9-4731-a384-ff8b7c9724d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e90ffa2-8ae9-4731-a384-ff8b7c9724d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d26ba5b-e2b0-4336-8c1a-aa46cadcb838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d26ba5b-e2b0-4336-8c1a-aa46cadcb838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd31d9651-5cd5-4187-84c2-3a42953ff1b6', 'volume_name': 'volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6', 'volume_size': 2, 'snapshot_id': 'ee9db169-5762-44e9-9842-e582dfc1d4e6'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317e371c-c96e-46c6-84ef-893353072368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317e371c-c96e-46c6-84ef-893353072368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:16 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16855c19-a977-41fc-9a91-b90cc48ce01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Volume d31d9651-5cd5-4187-84c2-3a42953ff1b6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6', 'volume_size': 2, 'snapshot_id': 'ee9db169-5762-44e9-9842-e582dfc1d4e6'} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-ee9db169-5762-44e9-9842-e582dfc1d4e6-d31d9651-5cd5-4187-84c2-3a42953ff1b6" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98576edd-c585-439c-bc5d-b1a1044e08e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182c73bf-f39b-4722-a7a4-14505514aebe', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1762ee8e-d354-4da0-a934-f01daf90d34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-ee9db169-5762-44e9-9842-e582dfc1d4e6-d31d9651-5cd5-4187-84c2-3a42953ff1b6" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Creating volume d31d9651-5cd5-4187-84c2-3a42953ff1b6 from snapshot ee9db169-5762-44e9-9842-e582dfc1d4e6 {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-d31d9651-5cd5-4187-84c2-3a42953ff1b6" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Volume volume-182c73bf-f39b-4722-a7a4-14505514aebe (182c73bf-f39b-4722-a7a4-14505514aebe): created successfully Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1762ee8e-d354-4da0-a934-f01daf90d34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Flow 'volume_create_manager' (96743fa0-2b63-40ba-927e-eff86df7dd86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-d31d9651-5cd5-4187-84c2-3a42953ff1b6" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] snapshot: ee9db169-5762-44e9-9842-e582dfc1d4e6, volume: d31d9651-5cd5-4187-84c2-3a42953ff1b6, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:12:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a97c0aef-2438-4ff2-be6a-e1d2b2f91a51 tempest-ProjectReaderTests-1371965929 None] Created volume successfully. Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:16 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbc7e07-8e6b-4dce-937f-64a0cbdf5b80]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:16 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e Sep 28 19:12:16 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:16 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 Sep 28 19:12:16 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:17 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-81b08680-7421-490f-aabf-3ec7f9ecb54e" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Lock "cinder-quobyte-81b08680-7421-490f-aabf-3ec7f9ecb54e" released by "delete_volume" :: held 0.840s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Created reservations ['ae051c69-a0c2-4ba2-878b-33ed3bfb11c8', '75f53698-af4e-4c6b-bd62-bd3889a742f2', '7bde9c06-df58-4423-a8e7-5fb4eda72c50', 'a126246b-cdea-4ba6-b6cf-dcffc068de5e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:17 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6" returned: 0 in 0.465s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:12:17 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:17 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96287ee-2416-4cff-ad95-93156cd4d8b3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:17 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f Sep 28 19:12:17 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Acquiring lock "cinder-182c73bf-f39b-4722-a7a4-14505514aebe-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Lock "cinder-182c73bf-f39b-4722-a7a4-14505514aebe-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Acquiring lock "cinder-quobyte-182c73bf-f39b-4722-a7a4-14505514aebe" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Lock "cinder-quobyte-182c73bf-f39b-4722-a7a4-14505514aebe" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:17 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.388s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Deleted volume successfully. Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7d6c34-211f-4a35-916d-62fda446d445]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dbf6e15a-4b5e-4fad-b652-8228e19609c7 tempest-VolumesTestJSON-1073508150 None] Lock "cinder-81b08680-7421-490f-aabf-3ec7f9ecb54e-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:17 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe Sep 28 19:12:17 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:17 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" returned: 0 in 0.526s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:12:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:17 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 Sep 28 19:12:17 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:18 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe" returned: 0 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:18 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe Sep 28 19:12:18 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:18 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-182c73bf-f39b-4722-a7a4-14505514aebe" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Lock "cinder-quobyte-182c73bf-f39b-4722-a7a4-14505514aebe" released by "delete_volume" :: held 0.902s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Created reservations ['60c4ac1e-d74e-4c54-a09d-51b9c52d1e87', '6c63ede0-10d3-4fb5-945a-a19e413085c9', '1cc01993-d721-4aca-86a2-a619793f3bcc', '9e8eef8b-5452-4c1d-9b73-0f9cbb03f6b6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:18 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:18 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:19 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.486s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Deleted volume successfully. Sep 28 19:12:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b90b7119-3305-4b8f-add2-36889c1eb805 tempest-ProjectReaderTests-1371965929 None] Lock "cinder-182c73bf-f39b-4722-a7a4-14505514aebe-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:26 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6" returned: 0 in 8.824s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:26 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f, size 1024.00 MB, duration 8.83 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:12:26 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Converted 1024.00 MB image at 116.02 MB/s Sep 28 19:12:26 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 is being set with open permissions: ugo+rw Sep 28 19:12:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:26 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 Sep 28 19:12:26 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4bb7d555-b90c-4527-a406-0dfb20067e78 tempest-GroupSnapshotsTest-326392352 None] Group tempest-GroupSnapshotsTest-Group-283439164: creating Sep 28 19:12:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4bb7d555-b90c-4527-a406-0dfb20067e78 tempest-GroupSnapshotsTest-326392352 None] Group tempest-GroupSnapshotsTest-Group-283439164: created successfully Sep 28 19:12:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4bb7d555-b90c-4527-a406-0dfb20067e78 tempest-GroupSnapshotsTest-326392352 None] Create group completed successfully. Sep 28 19:12:27 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-d31d9651-5cd5-4187-84c2-3a42953ff1b6" released by "_copy_volume_from_snapshot" :: held 10.282s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-ee9db169-5762-44e9-9842-e582dfc1d4e6-d31d9651-5cd5-4187-84c2-3a42953ff1b6" released by "_create_volume_from_snapshot" :: held 10.373s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.415s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16855c19-a977-41fc-9a91-b90cc48ce01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6', 'volume_size': 2, 'snapshot_id': 'ee9db169-5762-44e9-9842-e582dfc1d4e6'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44b9d03-d775-4233-8f66-6900fee34df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Volume volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 (d31d9651-5cd5-4187-84c2-3a42953ff1b6): created successfully Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44b9d03-d775-4233-8f66-6900fee34df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Flow 'volume_create_manager' (1843b37c-9665-4606-a0bb-00e6dfe18b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-16f604b2-f1a2-4dd1-a056-64336cb3cd5b tempest-VolumesSnapshotTestJSON-481411320 None] Created volume successfully. Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-d31d9651-5cd5-4187-84c2-3a42953ff1b6-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-d31d9651-5cd5-4187-84c2-3a42953ff1b6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-d31d9651-5cd5-4187-84c2-3a42953ff1b6" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-d31d9651-5cd5-4187-84c2-3a42953ff1b6" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7036e6-52ea-4686-b717-74b0b109f960]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:28 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 Sep 28 19:12:28 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:28 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6" returned: 0 in 0.443s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:28 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6 Sep 28 19:12:28 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:28 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d31d9651-5cd5-4187-84c2-3a42953ff1b6" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-d31d9651-5cd5-4187-84c2-3a42953ff1b6" released by "delete_volume" :: held 0.844s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Flow 'volume_create_manager' (c53bde68-9947-41a9-9009-4fdb05c2979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fc19db-a24a-4b08-b50e-9d5a0b91b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fc19db-a24a-4b08-b50e-9d5a0b91b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2008505328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a030560a-1403-41e3-bde4-4a0322e4c9b7,host='devstack@QuobyteHD#QuobyteHD',id=332b959a-c5b4-48c1-9ee5-421d50c934b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c452a23073cc47b2878f93dace622c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:29Z,use_quota=True,user_id='ff4d32e9e401442b99c0eb093e890c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7a73c58-f8de-4065-88e8-92038b49c125),volume_type_id=d7a73c58-f8de-4065-88e8-92038b49c125)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69d5a18-576d-4843-8d57-06b3e6ea13ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69d5a18-576d-4843-8d57-06b3e6ea13ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4553883c-d567-476b-9043-43ea4d84f522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4553883c-d567-476b-9043-43ea4d84f522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332b959a-c5b4-48c1-9ee5-421d50c934b0', 'volume_name': 'volume-332b959a-c5b4-48c1-9ee5-421d50c934b0', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47041247-a35d-40a9-8d82-216927566529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47041247-a35d-40a9-8d82-216927566529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c654c20-0436-4074-bc35-97401c793fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Volume 332b959a-c5b4-48c1-9ee5-421d50c934b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332b959a-c5b4-48c1-9ee5-421d50c934b0', 'volume_size': 1} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a030560a-1403-41e3-bde4-4a0322e4c9b7,created_at=2026-09-28T17:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2008505328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a030560a-1403-41e3-bde4-4a0322e4c9b7,host='devstack@QuobyteHD#QuobyteHD',id=332b959a-c5b4-48c1-9ee5-421d50c934b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c452a23073cc47b2878f93dace622c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:29Z,use_quota=True,user_id='ff4d32e9e401442b99c0eb093e890c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7a73c58-f8de-4065-88e8-92038b49c125),volume_type_id=d7a73c58-f8de-4065-88e8-92038b49c125)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Creating volume 332b959a-c5b4-48c1-9ee5-421d50c934b0 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:28 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:28 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 1073741824 Sep 28 19:12:28 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:28 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Created reservations ['e7ee9f8f-b666-4f6f-8c65-2539abb59941', 'd354aedd-6a80-4bd0-9018-44a0b26956d5', 'f997b50d-ef46-49b2-90ad-296b44c5353a', '8f15ec0e-accd-45d7-8026-c5be88b2c68a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:29 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:29 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:29 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Deleted volume successfully. Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5ba27fa-5c81-4eb6-9b23-b18edc262546 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-d31d9651-5cd5-4187-84c2-3a42953ff1b6-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:29 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 1073741824" returned: 0 in 0.639s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:29 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 Sep 28 19:12:29 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:29 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0" returned: 0 in 0.282s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c654c20-0436-4074-bc35-97401c793fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332b959a-c5b4-48c1-9ee5-421d50c934b0', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf485573-7504-402f-b6ef-1614138c5e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Volume volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 (332b959a-c5b4-48c1-9ee5-421d50c934b0): created successfully Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf485573-7504-402f-b6ef-1614138c5e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Flow 'volume_create_manager' (c53bde68-9947-41a9-9009-4fdb05c2979f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fd5cc610-6d4f-4b1e-8b47-14bd7fe635e3 tempest-GroupSnapshotsTest-326392352 None] Created volume successfully. Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-ee9db169-5762-44e9-9842-e582dfc1d4e6-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-ee9db169-5762-44e9-9842-e582dfc1d4e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-ee9db169-5762-44e9-9842-e582dfc1d4e6" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-ee9db169-5762-44e9-9842-e582dfc1d4e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Deleting offline snapshot ee9db169-5762-44e9-9842-e582dfc1d4e6 of volume 0deb004d-92c1-4c09-a6c8-2afe0cf7f93f {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] snapshot_file for this snap is: volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0234ea-e823-4498-bb9b-2227ed192f6a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:30 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 Sep 28 19:12:30 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:30 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6" returned: 0 in 0.440s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d654d13-8458-44ad-af3c-3d6bfad75cb3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:30 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f Sep 28 19:12:30 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:31 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" returned: 0 in 0.623s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:31 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 Sep 28 19:12:31 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] GroupSnapshot 92c4bc1c-7cc4-4541-b18a-0fde8f343da5: creating. Sep 28 19:12:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Group snapshot 92c4bc1c-7cc4-4541-b18a-0fde8f343da5: creating. {{(pid=86846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 19:12:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Creating offline snapshot 184c75be-a02d-4121-b1b5-c333f704f558 of volume 332b959a-c5b4-48c1-9ee5-421d50c934b0 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:12:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b4d524-6b8e-486d-847b-f5e58a60672b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:31 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 Sep 28 19:12:31 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:31 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6" returned: 0 in 0.428s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:31 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6 Sep 28 19:12:31 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:32 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0" returned: 0 in 0.566s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:32 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 1G Sep 28 19:12:32 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:32 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f.ee9db169-5762-44e9-9842-e582dfc1d4e6" returned: 0 in 0.475s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-ee9db169-5762-44e9-9842-e582dfc1d4e6" released by "_delete_snapshot" :: held 2.126s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" released by "delete_snapshot" :: held 2.160s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:32 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Created reservations ['3d044407-93a9-4f8a-bca6-d0352f35fe07', '23c1d917-194c-4108-8b3b-dbb1ee525329', 'd0826fc3-fded-46dc-85ee-752346e4298a', '093eea18-eecb-4200-a088-e91a8425b67a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Delete snapshot completed successfully. Sep 28 19:12:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35d1e4de-acfa-4d70-948b-3171a4ac9597 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-ee9db169-5762-44e9-9842-e582dfc1d4e6-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:32 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 1G" returned: 0 in 0.596s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:32 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 Sep 28 19:12:32 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:33 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:33 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:33 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 Sep 28 19:12:33 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:33 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558" returned: 0 in 0.303s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:33 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.info Sep 28 19:12:33 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a04bc4-8547-45c4-b494-a471f216238a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:33 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f Sep 28 19:12:33 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:33 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.info" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:33 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:12:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:33 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.info Sep 28 19:12:33 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:34 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" returned: 0 in 0.497s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:34 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.info" returned: 0 in 0.327s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:34 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f Sep 28 19:12:34 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b04a50fd-e86f-42e5-bb96-8dc2d5cddeb1 tempest-GroupSnapshotsTest-326392352 None] group_snapshot 92c4bc1c-7cc4-4541-b18a-0fde8f343da5: created successfully Sep 28 19:12:34 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" returned: 0 in 0.317s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f" released by "delete_volume" :: held 0.917s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Created reservations ['6aa86b06-4d5c-41dd-a9c2-a7cb03d3af4c', '7dd4eb23-2404-4f38-b70e-6f06747ff43b', '68b3b475-4a99-402d-9192-8df8f9764932', 'afae177e-94eb-4049-9a8e-3017a7fff5fd'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:34 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:34 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:34 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:34 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:35 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.475s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:12:35 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Deleted volume successfully. Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f89175cc-1083-4110-9a7b-d446226f7d27 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-0deb004d-92c1-4c09-a6c8-2afe0cf7f93f-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Flow 'volume_create_manager' (7dd848e1-9b7e-4b4a-b512-89bbfd4e8b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6239b29-3bad-4265-aa10-a92d33dbec2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6239b29-3bad-4265-aa10-a92d33dbec2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1765285632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4ae2bb-1e77-41bb-b6d3-a21464642070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd5ac18aee04511a869908b76c4212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:36Z,use_quota=True,user_id='a0b8a89a393648568d0553efc670d43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82484b99-b9c7-4b7d-8115-947d82e96f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82484b99-b9c7-4b7d-8115-947d82e96f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0d31c3-fe99-49cb-a01e-99754f2381c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0d31c3-fe99-49cb-a01e-99754f2381c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4ae2bb-1e77-41bb-b6d3-a21464642070', 'volume_name': 'volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568fa5d3-de8b-4492-a80c-2fe7bc22f4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568fa5d3-de8b-4492-a80c-2fe7bc22f4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d90916-ce1b-4faf-96ca-2737b94c9103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Volume 2f4ae2bb-1e77-41bb-b6d3-a21464642070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070', 'volume_size': 1} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1765285632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4ae2bb-1e77-41bb-b6d3-a21464642070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd5ac18aee04511a869908b76c4212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:36Z,use_quota=True,user_id='a0b8a89a393648568d0553efc670d43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Creating volume 2f4ae2bb-1e77-41bb-b6d3-a21464642070 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:35 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:12:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:36 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 1073741824 Sep 28 19:12:36 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:36 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 1073741824" returned: 0 in 0.601s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:36 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 Sep 28 19:12:36 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:36 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070" returned: 0 in 0.285s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.847s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-184c75be-a02d-4121-b1b5-c333f704f558-fccdad69-2262-4f2e-b2d4-e4b6701f7154" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d90916-ce1b-4faf-96ca-2737b94c9103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412b0c18-b754-4b06-8a7a-53369ad14292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-184c75be-a02d-4121-b1b5-c333f704f558-fccdad69-2262-4f2e-b2d4-e4b6701f7154" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Creating volume fccdad69-2262-4f2e-b2d4-e4b6701f7154 from snapshot 184c75be-a02d-4121-b1b5-c333f704f558 {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-fccdad69-2262-4f2e-b2d4-e4b6701f7154" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Volume volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 (2f4ae2bb-1e77-41bb-b6d3-a21464642070): created successfully Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412b0c18-b754-4b06-8a7a-53369ad14292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Flow 'volume_create_manager' (7dd848e1-9b7e-4b4a-b512-89bbfd4e8b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-fccdad69-2262-4f2e-b2d4-e4b6701f7154" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] snapshot: 184c75be-a02d-4121-b1b5-c333f704f558, volume: fccdad69-2262-4f2e-b2d4-e4b6701f7154, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:12:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2ca5f1f5-4744-404d-a3a4-cf9b83161e42 tempest-VolumesSnapshotTestJSON-481411320 None] Created volume successfully. Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f537908-47fc-4191-8784-b6b0aa88d12b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:37 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 Sep 28 19:12:37 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:37 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558" returned: 0 in 0.485s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-332b959a-c5b4-48c1-9ee5-421d50c934b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce34c86-1279-47d4-8f65-39950fcedfbc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:37 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 Sep 28 19:12:37 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:38 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0" returned: 0 in 0.553s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:12:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:12:38 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:12:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:38 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 Sep 28 19:12:38 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:45 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154" returned: 0 in 7.842s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0, size 1024.00 MB, duration 7.84 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:12:46 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Converted 1024.00 MB image at 130.56 MB/s Sep 28 19:12:46 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:46 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 Sep 28 19:12:46 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:46 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154" returned: 0 in 0.285s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-fccdad69-2262-4f2e-b2d4-e4b6701f7154" released by "_copy_volume_from_snapshot" :: held 9.305s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=107,cinder:UPDATE=132,cinder:INSERT=34,cinder:DELETE=13 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=112,cinder:UPDATE=136,cinder:INSERT=29,cinder:DELETE=11 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-184c75be-a02d-4121-b1b5-c333f704f558-fccdad69-2262-4f2e-b2d4-e4b6701f7154" released by "_create_volume_from_snapshot" :: held 9.401s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.436s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.167s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Creating offline snapshot a52f2c9a-c219-4ee8-a73a-a16b57829977 of volume 2f4ae2bb-1e77-41bb-b6d3-a21464642070 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2744c3-8af0-4aa0-a3fd-e0afdf710966]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a7d5857f-231b-4e75-8acc-ff35e6cc884a tempest-GroupSnapshotsTest-326392352 None] Create group from source-snapshot-92c4bc1c-7cc4-4541-b18a-0fde8f343da5 completed successfully. Sep 28 19:12:46 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 Sep 28 19:12:46 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:46 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070" returned: 0 in 0.465s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:46 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 1G Sep 28 19:12:46 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:47 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 1G" returned: 0 in 0.541s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:47 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 Sep 28 19:12:47 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-fccdad69-2262-4f2e-b2d4-e4b6701f7154" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-fccdad69-2262-4f2e-b2d4-e4b6701f7154" acquired by "delete_volume" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcff10b2-d1c7-48d7-a36d-294aae2e5a4e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:47 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 Sep 28 19:12:47 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:47 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:47 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 is being set with open permissions: ugo+rw Sep 28 19:12:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:47 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 Sep 28 19:12:47 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:48 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154" returned: 0 in 0.622s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:48 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154 Sep 28 19:12:48 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:48 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977" returned: 0 in 0.448s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:48 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.info Sep 28 19:12:48 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:48 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fccdad69-2262-4f2e-b2d4-e4b6701f7154" returned: 0 in 0.322s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-fccdad69-2262-4f2e-b2d4-e4b6701f7154" released by "delete_volume" :: held 1.009s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Created reservations ['b4c3bcf0-9293-4b12-a565-33a3ebbc0eeb'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:48 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.info" returned: 0 in 0.323s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:48 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.info is being set with open permissions: ugo+rw Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:48 devstack cinder-volume[86846]: WARNING cinder.quota [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1589503077 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1589503077, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:12:48 devstack cinder-volume[86846]: WARNING cinder.quota [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1589503077 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1589503077, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:12:48 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.info Sep 28 19:12:48 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Created reservations ['e02fb2c7-fc4c-43f7-88df-f04c587e4e71', 'a1cb5429-da81-43fd-a978-b922f762a7d0', '82428606-113b-4108-88d4-99d52fafb56e', 'fd2a093b-ac33-4fdf-af47-7ce01f5d5697'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:48 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:48 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:48 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.info" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.671s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1b327bec-2e9d-4e33-a36e-56af4aaef6f4 tempest-VolumesSnapshotTestJSON-481411320 None] Create snapshot completed successfully Sep 28 19:12:49 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:49 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f9bcb983-1087-4aca-b714-1c6682dbc452 tempest-GroupSnapshotsTest-326392352 None] Delete group completed successfully. Sep 28 19:12:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] group_snapshot 92c4bc1c-7cc4-4541-b18a-0fde8f343da5: deleting Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] group_snapshot 92c4bc1c-7cc4-4541-b18a-0fde8f343da5: deleting {{(pid=86846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-332b959a-c5b4-48c1-9ee5-421d50c934b0" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-332b959a-c5b4-48c1-9ee5-421d50c934b0" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-184c75be-a02d-4121-b1b5-c333f704f558" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-184c75be-a02d-4121-b1b5-c333f704f558" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Deleting offline snapshot 184c75be-a02d-4121-b1b5-c333f704f558 of volume 332b959a-c5b4-48c1-9ee5-421d50c934b0 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] snapshot_file for this snap is: volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b6c1a5-3c37-493d-9aa1-fce0ef23aafe]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:50 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 Sep 28 19:12:50 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Flow 'volume_create_manager' (561c7fd9-8612-4dec-99c0-c3647f73fc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba651eb-1b57-4aa5-bd2a-8d2946ec88c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba651eb-1b57-4aa5-bd2a-8d2946ec88c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1887698735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d8cc78-6b1a-4847-b833-69de843c89ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd5ac18aee04511a869908b76c4212f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a52f2c9a-c219-4ee8-a73a-a16b57829977,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:51Z,use_quota=True,user_id='a0b8a89a393648568d0553efc670d43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b97750-e06f-4c29-89c9-f28e104ce1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b97750-e06f-4c29-89c9-f28e104ce1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee80189-fb5a-4ad0-8b17-f142bd92f1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee80189-fb5a-4ad0-8b17-f142bd92f1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58d8cc78-6b1a-4847-b833-69de843c89ca', 'volume_name': 'volume-58d8cc78-6b1a-4847-b833-69de843c89ca', 'volume_size': 1, 'snapshot_id': 'a52f2c9a-c219-4ee8-a73a-a16b57829977'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b94d60-9ac3-4bda-a1b3-0d8ac5003e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b94d60-9ac3-4bda-a1b3-0d8ac5003e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c02ab2-2f89-45b6-b495-6a13d92ed82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Volume 58d8cc78-6b1a-4847-b833-69de843c89ca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58d8cc78-6b1a-4847-b833-69de843c89ca', 'volume_size': 1, 'snapshot_id': 'a52f2c9a-c219-4ee8-a73a-a16b57829977'} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-a52f2c9a-c219-4ee8-a73a-a16b57829977-58d8cc78-6b1a-4847-b833-69de843c89ca" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-a52f2c9a-c219-4ee8-a73a-a16b57829977-58d8cc78-6b1a-4847-b833-69de843c89ca" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Creating volume 58d8cc78-6b1a-4847-b833-69de843c89ca from snapshot a52f2c9a-c219-4ee8-a73a-a16b57829977 {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-58d8cc78-6b1a-4847-b833-69de843c89ca" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-58d8cc78-6b1a-4847-b833-69de843c89ca" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] snapshot: a52f2c9a-c219-4ee8-a73a-a16b57829977, volume: 58d8cc78-6b1a-4847-b833-69de843c89ca, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fe4a74-8afe-483b-9760-dcee7a601e04]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:51 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558" returned: 0 in 0.681s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-332b959a-c5b4-48c1-9ee5-421d50c934b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc885a15-27bc-4f6e-8389-f512316f5026]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:51 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 Sep 28 19:12:51 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:51 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 Sep 28 19:12:51 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:51 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977" returned: 0 in 0.505s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1ebe42-4f6e-4cee-b65e-bbd618edb4d8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:51 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 Sep 28 19:12:51 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:51 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0" returned: 0 in 0.817s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:51 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 Sep 28 19:12:51 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:52 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070" returned: 0 in 0.525s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:12:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:12:52 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:12:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:52 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca Sep 28 19:12:52 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:52 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558" returned: 0 in 0.441s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:52 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558 Sep 28 19:12:52 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:52 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0.184c75be-a02d-4121-b1b5-c333f704f558" returned: 0 in 0.383s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-184c75be-a02d-4121-b1b5-c333f704f558" released by "_delete_snapshot" :: held 2.553s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-332b959a-c5b4-48c1-9ee5-421d50c934b0" released by "delete_snapshot" :: held 2.597s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:53 devstack cinder-volume[86846]: WARNING cinder.quota [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1589503077 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1589503077, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:12:53 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] Created reservations ['475eac12-1e77-45b6-9f29-2541cf34c4a4', '2ab9e804-043b-49a1-825b-9fd491cbcd0e', '6730f051-7dc7-4a1c-b6af-eb005e4d4707', '8a9ee32f-5666-4510-aeab-800a25d2deaf'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8c36aa72-ec8c-4715-b48a-44cec8674ba7 tempest-GroupSnapshotsTest-326392352 None] group_snapshot 92c4bc1c-7cc4-4541-b18a-0fde8f343da5: deleted successfully Sep 28 19:12:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-332b959a-c5b4-48c1-9ee5-421d50c934b0" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:12:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-332b959a-c5b4-48c1-9ee5-421d50c934b0" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:12:54 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1711eec-c89c-4299-b70b-95d46515ae6f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:12:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:54 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 Sep 28 19:12:54 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:55 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0" returned: 0 in 1.138s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:55 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0 Sep 28 19:12:55 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:56 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-332b959a-c5b4-48c1-9ee5-421d50c934b0" returned: 0 in 0.628s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-332b959a-c5b4-48c1-9ee5-421d50c934b0" released by "delete_volume" :: held 1.932s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:12:56 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Created reservations ['ebf59657-8ec1-48a2-991b-3eb7a8c4e28c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:56 devstack cinder-volume[86846]: WARNING cinder.db.api [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1589503077'] Sep 28 19:12:56 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Created reservations ['b61fdee6-bd75-4eea-bfd3-cc4f15b7d206', 'a627a54f-7aee-4c26-9ee0-a01f8fed91c5', '8d688379-f9de-4967-9705-a3128edbbafe', '3e01c13f-8f47-490c-83ce-73cc8b1961c7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:12:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:12:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:12:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:12:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:12:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:12:57 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:12:57 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:12:57 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 28 19:12:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.583s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:12:57 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:12:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-42ef7611-d51c-4081-9616-4a99f3f6b6dc tempest-GroupSnapshotsTest-326392352 None] Delete group completed successfully. Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Flow 'volume_create_manager' (aec8eb22-8829-427e-afa5-b79c45107cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc6a99f-12ec-4947-9f9b-efc807be1dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc6a99f-12ec-4947-9f9b-efc807be1dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1513017650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0783225-876a-4721-b743-98e81d21c788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2971e94574045749d885bf2fb20f592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:58Z,use_quota=True,user_id='1cab4215c5294f6ab3a043c68fdca83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad819e9-c36a-4f65-a90b-a4f296706492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad819e9-c36a-4f65-a90b-a4f296706492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b03bd6-d3db-4d6d-89a9-534aa7d0177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b03bd6-d3db-4d6d-89a9-534aa7d0177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0783225-876a-4721-b743-98e81d21c788', 'volume_name': 'volume-b0783225-876a-4721-b743-98e81d21c788', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dea4cc2-846a-4105-9f97-6cebf66ff2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dea4cc2-846a-4105-9f97-6cebf66ff2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f919bb50-66b3-41e1-8ed9-8fea87b05919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:12:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Volume b0783225-876a-4721-b743-98e81d21c788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0783225-876a-4721-b743-98e81d21c788', 'volume_size': 1} Sep 28 19:12:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:12:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4c5a973a-c498-44d1-87c7-836a763432d9 tempest-GroupSnapshotsTest-326392352 None] Group tempest-GroupSnapshotsTest-Group-2085271767: creating Sep 28 19:12:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4c5a973a-c498-44d1-87c7-836a763432d9 tempest-GroupSnapshotsTest-326392352 None] Group tempest-GroupSnapshotsTest-Group-2085271767: created successfully Sep 28 19:12:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4c5a973a-c498-44d1-87c7-836a763432d9 tempest-GroupSnapshotsTest-326392352 None] Create group completed successfully. Sep 28 19:13:00 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca" returned: 0 in 8.719s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:13:00 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Converted 1024.00 MB image at 117.43 MB/s Sep 28 19:13:00 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca is being set with open permissions: ugo+rw Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:00 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca Sep 28 19:13:00 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Flow 'volume_create_manager' (930063c3-748e-4421-b56d-b0964e3a3c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f461bc8c-627e-43a9-b542-69f479dace0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f461bc8c-627e-43a9-b542-69f479dace0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779113939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1291a16e-ffdf-4475-a25d-c07e9f730b9d,host='devstack@QuobyteHD#QuobyteHD',id=209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c452a23073cc47b2878f93dace622c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:01Z,use_quota=True,user_id='ff4d32e9e401442b99c0eb093e890c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5652557-260a-4417-8384-492e4b0d65f4),volume_type_id=d5652557-260a-4417-8384-492e4b0d65f4)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683406e5-8720-4287-a924-f75b9269fc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683406e5-8720-4287-a924-f75b9269fc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572980ad-928b-4239-9d7c-52cd5828dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572980ad-928b-4239-9d7c-52cd5828dc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb', 'volume_name': 'volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b759b0d-745c-40a6-be91-7c4f1afd9e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b759b0d-745c-40a6-be91-7c4f1afd9e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e33061-2d3f-4df5-a18b-224bd4b315b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Volume 209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb', 'volume_size': 1} Sep 28 19:13:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:01 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-58d8cc78-6b1a-4847-b833-69de843c89ca" released by "_copy_volume_from_snapshot" :: held 10.172s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-a52f2c9a-c219-4ee8-a73a-a16b57829977-58d8cc78-6b1a-4847-b833-69de843c89ca" released by "_create_volume_from_snapshot" :: held 10.247s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.274s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.511s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1513017650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0783225-876a-4721-b743-98e81d21c788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2971e94574045749d885bf2fb20f592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:12:58Z,use_quota=True,user_id='1cab4215c5294f6ab3a043c68fdca83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Creating volume b0783225-876a-4721-b743-98e81d21c788 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:13:01 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:01 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 1073741824 Sep 28 19:13:01 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c02ab2-2f89-45b6-b495-6a13d92ed82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d8cc78-6b1a-4847-b833-69de843c89ca', 'volume_size': 1, 'snapshot_id': 'a52f2c9a-c219-4ee8-a73a-a16b57829977'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d1233c-53e0-4da5-9daf-7cb7351a0cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:01 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Volume volume-58d8cc78-6b1a-4847-b833-69de843c89ca (58d8cc78-6b1a-4847-b833-69de843c89ca): created successfully Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d1233c-53e0-4da5-9daf-7cb7351a0cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Flow 'volume_create_manager' (561c7fd9-8612-4dec-99c0-c3647f73fc15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-428f7370-9cde-4f9c-8cbc-cc07370b5829 tempest-VolumesSnapshotTestJSON-481411320 None] Created volume successfully. Sep 28 19:13:01 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 1073741824" returned: 0 in 0.472s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:01 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 Sep 28 19:13:01 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:01 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1291a16e-ffdf-4475-a25d-c07e9f730b9d,created_at=2026-09-28T17:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779113939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1291a16e-ffdf-4475-a25d-c07e9f730b9d,host='devstack@QuobyteHD#QuobyteHD',id=209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c452a23073cc47b2878f93dace622c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:01Z,use_quota=True,user_id='ff4d32e9e401442b99c0eb093e890c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5652557-260a-4417-8384-492e4b0d65f4),volume_type_id=d5652557-260a-4417-8384-492e4b0d65f4)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Creating volume 209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:13:01 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:13:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f919bb50-66b3-41e1-8ed9-8fea87b05919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0783225-876a-4721-b743-98e81d21c788', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:02 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb 1073741824 Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d685d46a-3589-4a2f-9dbb-72f41551e529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:02 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Volume volume-b0783225-876a-4721-b743-98e81d21c788 (b0783225-876a-4721-b743-98e81d21c788): created successfully Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d685d46a-3589-4a2f-9dbb-72f41551e529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Flow 'volume_create_manager' (aec8eb22-8829-427e-afa5-b79c45107cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-58d8cc78-6b1a-4847-b833-69de843c89ca-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-361d2643-1310-40fd-8207-fe0280bb5f43 tempest-SnapshotDependencyTests-1921522887 None] Created volume successfully. Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-58d8cc78-6b1a-4847-b833-69de843c89ca-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-58d8cc78-6b1a-4847-b833-69de843c89ca" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-58d8cc78-6b1a-4847-b833-69de843c89ca" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[679ddfa2-963b-40c8-bc7a-efbd0e2504ae]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:02 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca Sep 28 19:13:02 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:02 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb 1073741824" returned: 0 in 0.584s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:02 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb Sep 28 19:13:02 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:02 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:02 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca Sep 28 19:13:02 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:02 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" returned: 0 in 0.336s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.148s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e33061-2d3f-4df5-a18b-224bd4b315b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c84427-f53f-4178-9c27-970bb2738ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Creating offline snapshot 4e6a868e-31c3-46f2-9b2c-eb17550d640f of volume b0783225-876a-4721-b743-98e81d21c788 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:13:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Volume volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb (209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb): created successfully Sep 28 19:13:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c84427-f53f-4178-9c27-970bb2738ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:03 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Flow 'volume_create_manager' (930063c3-748e-4421-b56d-b0964e3a3c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-58d8cc78-6b1a-4847-b833-69de843c89ca" returned: 0 in 0.315s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bdc5dd-7eb3-4917-9375-88f7301a5c3e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-58d8cc78-6b1a-4847-b833-69de843c89ca" released by "delete_volume" :: held 0.877s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e3ef8980-1f23-40bf-adbb-9d2891c34946 tempest-GroupSnapshotsTest-326392352 None] Created volume successfully. Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Created reservations ['d8bd32e5-548d-4eba-9e19-58ffe572565a', '0d39f1db-59a8-42e3-85de-359749b65ac5', '5d40e099-d5da-4ffc-98ae-b3ffaf65d769', 'ecbe68c0-009e-4197-bf95-f064632aa8f3'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:03 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 Sep 28 19:13:03 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:03 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:13:03 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-a52f2c9a-c219-4ee8-a73a-a16b57829977-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-a52f2c9a-c219-4ee8-a73a-a16b57829977-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-2f4ae2bb-1e77-41bb-b6d3-a21464642070" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-2f4ae2bb-1e77-41bb-b6d3-a21464642070" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-a52f2c9a-c219-4ee8-a73a-a16b57829977" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-a52f2c9a-c219-4ee8-a73a-a16b57829977" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Deleting offline snapshot a52f2c9a-c219-4ee8-a73a-a16b57829977 of volume 2f4ae2bb-1e77-41bb-b6d3-a21464642070 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] snapshot_file for this snap is: volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdff1a28-2dea-40cd-a5c5-9cac9bd8adf1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:03 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788" returned: 0 in 0.509s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:03 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f 1G Sep 28 19:13:03 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:03 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.376s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:13:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Deleted volume successfully. Sep 28 19:13:03 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 Sep 28 19:13:03 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cdff3074-f266-4c68-b4b1-dc61a48dbb64 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-58d8cc78-6b1a-4847-b833-69de843c89ca-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:03 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977" returned: 0 in 0.460s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f95fdfe-ee30-4415-bc1e-d18ca6b9cfd5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:04 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f 1G" returned: 0 in 0.639s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0783225-876a-4721-b743-98e81d21c788 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:04 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 Sep 28 19:13:04 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:04 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0783225-876a-4721-b743-98e81d21c788 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f Sep 28 19:13:04 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Flow 'volume_create_manager' (1200ac07-5101-44c5-b4d3-f609db647333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3950b914-a38c-4a71-82c9-2ccbe302d19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3950b914-a38c-4a71-82c9-2ccbe302d19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1682403387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1291a16e-ffdf-4475-a25d-c07e9f730b9d,host='devstack@QuobyteHD#QuobyteHD',id=3c1cd76a-3236-4ac7-aa73-2d47882e985f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c452a23073cc47b2878f93dace622c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:04Z,use_quota=True,user_id='ff4d32e9e401442b99c0eb093e890c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5652557-260a-4417-8384-492e4b0d65f4),volume_type_id=d5652557-260a-4417-8384-492e4b0d65f4)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8099c6cc-9dd6-4bc0-9da7-8029b3b1ed7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8099c6cc-9dd6-4bc0-9da7-8029b3b1ed7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1fa4f7-963c-4785-b67f-8abaf08af25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1fa4f7-963c-4785-b67f-8abaf08af25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c1cd76a-3236-4ac7-aa73-2d47882e985f', 'volume_name': 'volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488a3a76-ca0e-40d9-ba91-e3e5e181169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488a3a76-ca0e-40d9-ba91-e3e5e181169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74b3fec-c2a7-4218-b39e-8e61261b7051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Volume 3c1cd76a-3236-4ac7-aa73-2d47882e985f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f', 'volume_size': 1} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:04 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0783225-876a-4721-b743-98e81d21c788 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f" returned: 0 in 0.386s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:04 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f is being set with open permissions: ugo+rw Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:04 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f Sep 28 19:13:04 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:04 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070" returned: 0 in 0.686s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:04 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 Sep 28 19:13:04 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:04 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:04 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.info Sep 28 19:13:04 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:05 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977" returned: 0 in 0.364s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:05 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977 Sep 28 19:13:05 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:05 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.info" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:05 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.info is being set with open permissions: ugo+rw Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:05 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.info Sep 28 19:13:05 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:05 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070.a52f2c9a-c219-4ee8-a73a-a16b57829977" returned: 0 in 0.303s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-a52f2c9a-c219-4ee8-a73a-a16b57829977" released by "_delete_snapshot" :: held 1.952s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-2f4ae2bb-1e77-41bb-b6d3-a21464642070" released by "delete_snapshot" :: held 1.991s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:05 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.info" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.562s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1291a16e-ffdf-4475-a25d-c07e9f730b9d,created_at=2026-09-28T17:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1682403387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1291a16e-ffdf-4475-a25d-c07e9f730b9d,host='devstack@QuobyteHD#QuobyteHD',id=3c1cd76a-3236-4ac7-aa73-2d47882e985f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c452a23073cc47b2878f93dace622c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:04Z,use_quota=True,user_id='ff4d32e9e401442b99c0eb093e890c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5652557-260a-4417-8384-492e4b0d65f4),volume_type_id=d5652557-260a-4417-8384-492e4b0d65f4)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Creating volume 3c1cd76a-3236-4ac7-aa73-2d47882e985f {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:13:05 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:05 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f 1073741824 Sep 28 19:13:05 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Created reservations ['fa703c95-f169-42fd-be19-01af4b7d6552', 'edf38852-f515-4701-a2d0-ce57d80aa98e', '7de5b0cc-10c7-407d-8fa2-6c3ce2178839', 'a3285a9e-dfe9-4ad3-95c0-2ce21a3ddd6d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3bc22733-2a0a-47e5-bdc6-fa9fdca476ba tempest-SnapshotDependencyTests-1921522887 None] Create snapshot completed successfully Sep 28 19:13:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Delete snapshot completed successfully. Sep 28 19:13:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b0c49105-e82d-4828-8d3c-9d4936a8b72d tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-a52f2c9a-c219-4ee8-a73a-a16b57829977-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:06 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f 1073741824" returned: 0 in 0.490s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:06 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f Sep 28 19:13:06 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:06 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f" returned: 0 in 0.271s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74b3fec-c2a7-4218-b39e-8e61261b7051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e174ff-f1d3-4a44-893c-2d12ab89f9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:06 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Volume volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f (3c1cd76a-3236-4ac7-aa73-2d47882e985f): created successfully Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e174ff-f1d3-4a44-893c-2d12ab89f9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Flow 'volume_create_manager' (1200ac07-5101-44c5-b4d3-f609db647333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bede4fa3-dea8-40c5-afaf-ed6718e97605 tempest-GroupSnapshotsTest-326392352 None] Created volume successfully. Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-2f4ae2bb-1e77-41bb-b6d3-a21464642070-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Flow 'volume_create_manager' (6c403f6a-3be3-441f-ac15-1422244fc310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b94248-e36b-4cb8-b250-aa7879170f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b94248-e36b-4cb8-b250-aa7879170f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219b0a3c-88c7-4b26-8034-ab7901e4dcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2971e94574045749d885bf2fb20f592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4e6a868e-31c3-46f2-9b2c-eb17550d640f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:07Z,use_quota=True,user_id='1cab4215c5294f6ab3a043c68fdca83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1851295a-f1e0-4e9b-92bb-21b997463185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1851295a-f1e0-4e9b-92bb-21b997463185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8eeea7-6a83-40f2-9057-00657e07bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8eeea7-6a83-40f2-9057-00657e07bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '219b0a3c-88c7-4b26-8034-ab7901e4dcd2', 'volume_name': 'volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2', 'volume_size': 1, 'snapshot_id': '4e6a868e-31c3-46f2-9b2c-eb17550d640f'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81af19e4-53c1-488e-b9ac-d02a132d42a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81af19e4-53c1-488e-b9ac-d02a132d42a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4fa72e-4fd8-450f-a42b-22981d5f128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:06 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Volume 219b0a3c-88c7-4b26-8034-ab7901e4dcd2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2', 'volume_size': 1, 'snapshot_id': '4e6a868e-31c3-46f2-9b2c-eb17550d640f'} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-2f4ae2bb-1e77-41bb-b6d3-a21464642070-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "cinder-quobyte-4e6a868e-31c3-46f2-9b2c-eb17550d640f-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-4e6a868e-31c3-46f2-9b2c-eb17550d640f-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Creating volume 219b0a3c-88c7-4b26-8034-ab7901e4dcd2 from snapshot 4e6a868e-31c3-46f2-9b2c-eb17550d640f {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "cinder-quobyte-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-2f4ae2bb-1e77-41bb-b6d3-a21464642070" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] snapshot: 4e6a868e-31c3-46f2-9b2c-eb17550d640f, volume: 219b0a3c-88c7-4b26-8034-ab7901e4dcd2, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-2f4ae2bb-1e77-41bb-b6d3-a21464642070" acquired by "delete_volume" :: waited 0.061s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7f97ae-409f-4271-bdae-b51ebe5e8b2e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c169da-d72a-4ab6-8cfb-b644af21708c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6d1bae57-204b-4c87-bc2c-464fe7d6ad5d tempest-GroupSnapshotsTest-326392352 None] Update group completed successfully. Sep 28 19:13:07 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f Sep 28 19:13:07 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:07 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 Sep 28 19:13:07 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:07 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f" returned: 0 in 0.426s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0783225-876a-4721-b743-98e81d21c788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[56476800-c73a-427d-9b75-b79575edb638]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:07 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070" returned: 0 in 0.449s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:07 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070 Sep 28 19:13:07 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:07 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 Sep 28 19:13:07 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:07 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f4ae2bb-1e77-41bb-b6d3-a21464642070" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-2f4ae2bb-1e77-41bb-b6d3-a21464642070" released by "delete_volume" :: held 0.832s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Created reservations ['82039f6b-d39f-48a1-868b-fc94498e859b', '010105b6-fb0f-45b0-b199-b0cb2f6d68a3', '2815a285-1ca9-4820-88e4-fe59253ef2c1', '42de4671-6afb-40d1-8ea7-7cde3de6851f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:07 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788" returned: 0 in 0.442s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:13:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:07 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 Sep 28 19:13:07 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:08 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:13:08 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-15455d1d-4b45-4caa-b8ae-103dfb84a86e tempest-GroupSnapshotsTest-326392352 None] Update group completed successfully. Sep 28 19:13:08 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.374s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:08 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:13:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Deleted volume successfully. Sep 28 19:13:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c9bf7e98-2c2f-492a-bcfd-4a992b9f98e5 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-2f4ae2bb-1e77-41bb-b6d3-a21464642070-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-1fe47224-e314-4ec0-a184-a0ff78d89d35-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-1fe47224-e314-4ec0-a184-a0ff78d89d35-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "cinder-quobyte-1fe47224-e314-4ec0-a184-a0ff78d89d35" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-1fe47224-e314-4ec0-a184-a0ff78d89d35" acquired by "delete_volume" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c037eb0-30fb-48d9-8b53-0e11234b3dbb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a0e4d8b7-85cf-4ab5-ba2e-afefb39e1d61 tempest-GroupSnapshotsTest-326392352 None] Update group completed successfully. Sep 28 19:13:09 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 Sep 28 19:13:09 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:10 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35" returned: 0 in 0.731s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:10 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35 Sep 28 19:13:10 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:10 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1fe47224-e314-4ec0-a184-a0ff78d89d35" returned: 0 in 0.509s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-quobyte-1fe47224-e314-4ec0-a184-a0ff78d89d35" released by "delete_volume" :: held 1.440s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2d519775-0fe9-4953-bc80-d28d916fbbb3 tempest-GroupSnapshotsTest-326392352 None] Update group completed successfully. Sep 28 19:13:10 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Created reservations ['ad89af5f-dde7-4778-b078-9cd623f17480', '1d03ff93-41c4-4b40-af4e-967a85ea09cd', 'fb6dd321-6ffe-40a1-a6de-293ff3aec62b', '0b2bd949-ae34-4689-8053-be7f7e6af63c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:11 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:13:11 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:11 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.534s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:11 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:13:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Deleted volume successfully. Sep 28 19:13:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15395f8c-4158-455c-85b4-f8586d0822a9 tempest-VolumesSnapshotTestJSON-481411320 None] Lock "cinder-1fe47224-e314-4ec0-a184-a0ff78d89d35-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] GroupSnapshot a887f66e-8327-4391-bb16-f9eb2c1e14a2: creating. Sep 28 19:13:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Group snapshot a887f66e-8327-4391-bb16-f9eb2c1e14a2: creating. {{(pid=86846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 19:13:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:16 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" returned: 0 in 8.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788, size 1024.00 MB, duration 8.36 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:13:16 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Converted 1024.00 MB image at 122.42 MB/s Sep 28 19:13:16 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 is being set with open permissions: ugo+rw Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:16 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 Sep 28 19:13:16 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:16 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" returned: 0 in 0.317s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" released by "_copy_volume_from_snapshot" :: held 9.693s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-4e6a868e-31c3-46f2-9b2c-eb17550d640f-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" released by "_create_volume_from_snapshot" :: held 9.811s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.847s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.440s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Creating offline snapshot 0ae28529-3085-4f0a-be37-19f7eae675f5 of volume 3c1cd76a-3236-4ac7-aa73-2d47882e985f {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4fa72e-4fd8-450f-a42b-22981d5f128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2', 'volume_size': 1, 'snapshot_id': '4e6a868e-31c3-46f2-9b2c-eb17550d640f'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29e8b9f-7d5b-4e98-ba6a-7cb414577e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ad3820-9c44-4f15-914b-5a5486b918e7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Volume volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 (219b0a3c-88c7-4b26-8034-ab7901e4dcd2): created successfully Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29e8b9f-7d5b-4e98-ba6a-7cb414577e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Flow 'volume_create_manager' (6c403f6a-3be3-441f-ac15-1422244fc310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6c1a0694-90f4-409f-b377-2071bf257582 tempest-SnapshotDependencyTests-1921522887 None] Created volume successfully. Sep 28 19:13:16 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f Sep 28 19:13:16 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:17 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f" returned: 0 in 0.473s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:17 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 1G Sep 28 19:13:17 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:17 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 1G" returned: 0 in 0.619s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:17 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 Sep 28 19:13:17 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "cinder-4e6a868e-31c3-46f2-9b2c-eb17550d640f-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-4e6a868e-31c3-46f2-9b2c-eb17550d640f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "cinder-quobyte-b0783225-876a-4721-b743-98e81d21c788" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-b0783225-876a-4721-b743-98e81d21c788" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "cinder-quobyte-4e6a868e-31c3-46f2-9b2c-eb17550d640f" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-4e6a868e-31c3-46f2-9b2c-eb17550d640f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Deleting offline snapshot 4e6a868e-31c3-46f2-9b2c-eb17550d640f of volume b0783225-876a-4721-b743-98e81d21c788 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] snapshot_file for this snap is: volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[02644aad-9181-45a3-be15-2a725f086a33]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:18 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f Sep 28 19:13:18 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:18 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:18 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:18 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 Sep 28 19:13:18 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:18 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:18 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f" returned: 0 in 0.478s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0783225-876a-4721-b743-98e81d21c788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cbac38-58cd-4afe-b67c-fcbde64b2200]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:18 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.info Sep 28 19:13:18 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:18 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 Sep 28 19:13:18 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:19 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.info" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:19 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:19 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.info Sep 28 19:13:19 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:19 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.info" returned: 0 in 0.322s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:19 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788" returned: 0 in 0.732s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Creating offline snapshot 41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae of volume 209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:13:19 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f Sep 28 19:13:19 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac83b76-8cba-45f2-8dd4-6c78d806744b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:19 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb Sep 28 19:13:19 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:19 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f" returned: 0 in 0.509s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:19 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f Sep 28 19:13:19 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:19 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" returned: 0 in 0.508s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:19 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae 1G Sep 28 19:13:19 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:20 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788.4e6a868e-31c3-46f2-9b2c-eb17550d640f" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-4e6a868e-31c3-46f2-9b2c-eb17550d640f" released by "_delete_snapshot" :: held 2.215s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-b0783225-876a-4721-b743-98e81d21c788" released by "delete_snapshot" :: held 2.247s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:20 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Created reservations ['3fc15ee3-b2ff-420e-90e1-8e8def1d3ad8', '25aa8e23-3788-4bd4-bfe5-48361dca510d', '247d9cb4-32ca-4826-ab62-c3138c8d26ee', 'cf983109-02a0-4a8f-bd00-ad4258f617f6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Delete snapshot completed successfully. Sep 28 19:13:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f63e1603-ba23-4526-832c-35b9fa771bf2 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-4e6a868e-31c3-46f2-9b2c-eb17550d640f-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:20 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae 1G" returned: 0 in 0.641s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:20 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae Sep 28 19:13:20 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:20 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:20 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:13:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:20 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae Sep 28 19:13:20 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "cinder-b0783225-876a-4721-b743-98e81d21c788-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:21 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae" returned: 0 in 0.313s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-b0783225-876a-4721-b743-98e81d21c788-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:21 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.info Sep 28 19:13:21 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "cinder-quobyte-b0783225-876a-4721-b743-98e81d21c788" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-b0783225-876a-4721-b743-98e81d21c788" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4fc541-5f07-4fe5-bbd2-961f79ebe6f1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:21 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 Sep 28 19:13:21 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:21 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.info" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:21 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:21 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.info Sep 28 19:13:21 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:21 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:21 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788 Sep 28 19:13:21 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:21 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.info" returned: 0 in 0.329s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-198ccd31-42a5-4aa2-b408-dfa02a870db2 tempest-GroupSnapshotsTest-326392352 None] group_snapshot a887f66e-8327-4391-bb16-f9eb2c1e14a2: created successfully Sep 28 19:13:22 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0783225-876a-4721-b743-98e81d21c788" returned: 0 in 0.330s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-b0783225-876a-4721-b743-98e81d21c788" released by "delete_volume" :: held 0.867s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Created reservations ['befa0172-32ff-4f09-8729-99289830e343', 'fead2ac5-b098-4fa3-9845-b9374e00d7fc', '6d01f3dd-7a88-4b29-90e8-076c3c275af1', 'ac0612d4-3bfb-4695-9893-97aaaec848fe'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:22 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:13:22 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:22 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:13:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Deleted volume successfully. Sep 28 19:13:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-54a3e4f2-484c-46bf-a552-3263d0d26b10 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-b0783225-876a-4721-b743-98e81d21c788-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] group_snapshot a887f66e-8327-4391-bb16-f9eb2c1e14a2: deleting Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] group_snapshot a887f66e-8327-4391-bb16-f9eb2c1e14a2: deleting {{(pid=86846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-3c1cd76a-3236-4ac7-aa73-2d47882e985f" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-3c1cd76a-3236-4ac7-aa73-2d47882e985f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-0ae28529-3085-4f0a-be37-19f7eae675f5" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-0ae28529-3085-4f0a-be37-19f7eae675f5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Deleting offline snapshot 0ae28529-3085-4f0a-be37-19f7eae675f5 of volume 3c1cd76a-3236-4ac7-aa73-2d47882e985f {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] snapshot_file for this snap is: volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[25213c36-9872-4f4c-ba61-dba493653c75]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:23 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 Sep 28 19:13:23 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "cinder-219b0a3c-88c7-4b26-8034-ab7901e4dcd2-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-219b0a3c-88c7-4b26-8034-ab7901e4dcd2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "cinder-quobyte-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7202a19f-71ed-450e-a9f4-e4ce6dfb8a4b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:23 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d5e495-e554-47ec-950b-68c789845762]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:23 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 Sep 28 19:13:23 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:23 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f Sep 28 19:13:23 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:24 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" returned: 0 in 0.497s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:24 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2 Sep 28 19:13:24 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:24 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f" returned: 0 in 0.483s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:24 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 Sep 28 19:13:24 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:24 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-quobyte-219b0a3c-88c7-4b26-8034-ab7901e4dcd2" released by "delete_volume" :: held 0.873s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Created reservations ['d16afd9f-f5f8-41f6-a5a9-1f94f142a31a', 'd774ef6a-4f41-4bb8-be3f-208f45007e9c', '8b9be7b9-4b19-4ace-9376-4e5991daf02e', 'bac7f4e1-0ec8-4e1d-a7c9-4254048ac429'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:24 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:13:24 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:24 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5" returned: 0 in 0.541s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:24 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5 Sep 28 19:13:24 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:25 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.365s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:13:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Deleted volume successfully. Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a9ecbc1-3005-4e89-bd08-112bb2250b58 tempest-SnapshotDependencyTests-1921522887 None] Lock "cinder-219b0a3c-88c7-4b26-8034-ab7901e4dcd2-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:25 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f.0ae28529-3085-4f0a-be37-19f7eae675f5" returned: 0 in 0.366s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-0ae28529-3085-4f0a-be37-19f7eae675f5" released by "_delete_snapshot" :: held 2.047s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-3c1cd76a-3236-4ac7-aa73-2d47882e985f" released by "delete_snapshot" :: held 2.080s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Deleting offline snapshot 41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae of volume 209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] snapshot_file for this snap is: volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a49fbe-582e-488a-90bf-ced13d5e3690]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:25 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae Sep 28 19:13:25 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:25 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae" returned: 0 in 0.511s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50ef655-a973-4548-82b4-6e47abaa6e92]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:26 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb Sep 28 19:13:26 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:26 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" returned: 0 in 0.533s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:26 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae Sep 28 19:13:26 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:26 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae" returned: 0 in 0.480s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:26 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae Sep 28 19:13:26 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:27 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb.41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae" returned: 0 in 0.395s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-41cfc3e6-06ea-4d82-8f3e-9cdef09a03ae" released by "_delete_snapshot" :: held 2.083s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" released by "delete_snapshot" :: held 2.118s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:27 devstack cinder-volume[86846]: WARNING cinder.quota [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-181405709 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-181405709, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:13:27 devstack cinder-volume[86846]: WARNING cinder.quota [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-181405709 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-181405709, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:13:27 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Created reservations ['f01ef6da-db11-44d0-a399-24447cfac679', '329b5aed-417d-4214-ac4c-355912166fa5', '46185426-6441-47b7-b44d-e39874fd5f8e', '8d26d19a-eff7-463b-a542-051fcbf00980'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:27 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] Created reservations ['e5cc1061-6450-4b26-ad83-3e174b4a3d2a', 'e02d4e43-5cbd-4c7e-b13c-ee468764a945', 'da3450bf-4183-4638-a7c5-7f66d62d4679', 'f005fb3e-90b5-4882-88b6-1214fc23e413'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2daf37bf-7618-4441-9530-3414af21cd3e tempest-GroupSnapshotsTest-326392352 None] group_snapshot a887f66e-8327-4391-bb16-f9eb2c1e14a2: deleted successfully Sep 28 19:13:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33534b2-aa3d-4214-87d7-88ea4bcccb0d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:29 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb Sep 28 19:13:29 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:29 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" returned: 0 in 0.543s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:30 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb Sep 28 19:13:30 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:30 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" returned: 0 in 0.328s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-209f9e9d-c1bd-4d67-a21e-9b68ebec3bdb" released by "delete_volume" :: held 0.995s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-3c1cd76a-3236-4ac7-aa73-2d47882e985f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-3c1cd76a-3236-4ac7-aa73-2d47882e985f" acquired by "delete_volume" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b42a5a-25c2-472e-a9c8-50f7692e4595]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:30 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f Sep 28 19:13:30 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:30 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f" returned: 0 in 0.566s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:31 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f Sep 28 19:13:31 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:31 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3c1cd76a-3236-4ac7-aa73-2d47882e985f" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-3c1cd76a-3236-4ac7-aa73-2d47882e985f" released by "delete_volume" :: held 1.013s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Created reservations ['c113ad62-306e-458f-a7ba-fb0e82f5d467'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:31 devstack cinder-volume[86846]: WARNING cinder.quota [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-181405709 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-181405709, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Created reservations ['cd7092b7-23a4-40e8-92fb-64a681ce178b', '7db1bc1c-36c0-4667-8c7c-44086819a1f3', '1b1f571f-7516-4c07-a50f-f6d525481720', '6f335946-acb0-4f13-90c3-48f45ad2f5cb'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Created reservations ['a969373a-d80d-4372-a7b6-3f46d5cc5f05', '1254830d-dd95-439a-8e1b-bc095d476bf7', '57f58981-2bf0-4bea-93da-cb6ad2835b8d', '2fa0850d-8d51-4853-ac95-4110e03a6076'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:32 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:13:32 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:32 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.406s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:32 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:13:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d289e899-a837-4fea-b6f5-81f2ba893a5b tempest-GroupSnapshotsTest-326392352 None] Delete group completed successfully. Sep 28 19:13:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3e3857b4-40a4-44fb-b1bd-4204603bb8f0 tempest-GroupSnapshotsTest-326392352 None] Group tempest-GroupSnapshotsTest-Group-1038169132: creating Sep 28 19:13:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3e3857b4-40a4-44fb-b1bd-4204603bb8f0 tempest-GroupSnapshotsTest-326392352 None] Group tempest-GroupSnapshotsTest-Group-1038169132: created successfully Sep 28 19:13:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3e3857b4-40a4-44fb-b1bd-4204603bb8f0 tempest-GroupSnapshotsTest-326392352 None] Create group completed successfully. Sep 28 19:13:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:13:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:34 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:13:34 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:34 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.353s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Flow 'volume_create_manager' (de448c9c-8506-4b26-bef6-533ced6d9d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234e3060-175e-407e-bd5a-b3f34d5941e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234e3060-175e-407e-bd5a-b3f34d5941e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-264933540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83a225f6-65e0-4a30-8642-ed615aa099d8,host='devstack@QuobyteHD#QuobyteHD',id=9673d409-9723-4bdc-829f-d1a7600458f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c452a23073cc47b2878f93dace622c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:36Z,use_quota=True,user_id='ff4d32e9e401442b99c0eb093e890c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc15954d-c1cf-49cd-8f9b-cef30cd333ac),volume_type_id=cc15954d-c1cf-49cd-8f9b-cef30cd333ac)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c43c813-3dfd-4795-add9-1bc48daf5595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c43c813-3dfd-4795-add9-1bc48daf5595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e7485d-f667-4cdc-a004-057d0187fdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e7485d-f667-4cdc-a004-057d0187fdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9673d409-9723-4bdc-829f-d1a7600458f3', 'volume_name': 'volume-9673d409-9723-4bdc-829f-d1a7600458f3', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f61693d-4856-4ac6-bf61-ef0da84f1b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f61693d-4856-4ac6-bf61-ef0da84f1b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a027fcd5-33d9-4977-9021-e964f4a4b6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Volume 9673d409-9723-4bdc-829f-d1a7600458f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9673d409-9723-4bdc-829f-d1a7600458f3', 'volume_size': 1} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83a225f6-65e0-4a30-8642-ed615aa099d8,created_at=2026-09-28T17:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-264933540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83a225f6-65e0-4a30-8642-ed615aa099d8,host='devstack@QuobyteHD#QuobyteHD',id=9673d409-9723-4bdc-829f-d1a7600458f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c452a23073cc47b2878f93dace622c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:36Z,use_quota=True,user_id='ff4d32e9e401442b99c0eb093e890c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc15954d-c1cf-49cd-8f9b-cef30cd333ac),volume_type_id=cc15954d-c1cf-49cd-8f9b-cef30cd333ac)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Creating volume 9673d409-9723-4bdc-829f-d1a7600458f3 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:13:36 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:36 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 1073741824 Sep 28 19:13:36 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:36 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 1073741824" returned: 0 in 0.662s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:36 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 Sep 28 19:13:36 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:37 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3" returned: 0 in 0.398s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:13:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a027fcd5-33d9-4977-9021-e964f4a4b6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9673d409-9723-4bdc-829f-d1a7600458f3', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3eedcd-7d8b-48b3-8cd9-00879b9db667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Volume volume-9673d409-9723-4bdc-829f-d1a7600458f3 (9673d409-9723-4bdc-829f-d1a7600458f3): created successfully Sep 28 19:13:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3eedcd-7d8b-48b3-8cd9-00879b9db667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Flow 'volume_create_manager' (de448c9c-8506-4b26-bef6-533ced6d9d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d891191b-c0a3-41f1-8d34-824c17455101 tempest-GroupSnapshotsTest-326392352 None] Created volume successfully. Sep 28 19:13:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] GroupSnapshot ed9732d3-31ad-4a16-8f55-59fbb5d67b45: creating. Sep 28 19:13:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Group snapshot ed9732d3-31ad-4a16-8f55-59fbb5d67b45: creating. {{(pid=86846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 19:13:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Creating offline snapshot 9767433b-ea9b-4db1-b4fc-5c9cbaf4480a of volume 9673d409-9723-4bdc-829f-d1a7600458f3 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:13:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64254a3-7430-42f3-8bfd-e1df3f04573e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:38 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 Sep 28 19:13:38 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:39 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3" returned: 0 in 0.479s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:39 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a 1G Sep 28 19:13:39 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:39 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a 1G" returned: 0 in 0.629s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9673d409-9723-4bdc-829f-d1a7600458f3 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:39 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9673d409-9723-4bdc-829f-d1a7600458f3 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a Sep 28 19:13:39 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:40 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9673d409-9723-4bdc-829f-d1a7600458f3 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a" returned: 0 in 0.425s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:40 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:13:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:40 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a Sep 28 19:13:40 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:40 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:40 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.info Sep 28 19:13:40 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:40 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.info" returned: 0 in 0.311s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:40 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:13:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:40 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.info Sep 28 19:13:40 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:41 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.info" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d05672ab-553d-4ee7-bbb0-facac3f3e126 tempest-GroupSnapshotsTest-326392352 None] group_snapshot ed9732d3-31ad-4a16-8f55-59fbb5d67b45: created successfully Sep 28 19:13:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] group_snapshot ed9732d3-31ad-4a16-8f55-59fbb5d67b45: deleting Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] group_snapshot ed9732d3-31ad-4a16-8f55-59fbb5d67b45: deleting {{(pid=86846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-9673d409-9723-4bdc-829f-d1a7600458f3" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-9673d409-9723-4bdc-829f-d1a7600458f3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-9767433b-ea9b-4db1-b4fc-5c9cbaf4480a" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-9767433b-ea9b-4db1-b4fc-5c9cbaf4480a" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Deleting offline snapshot 9767433b-ea9b-4db1-b4fc-5c9cbaf4480a of volume 9673d409-9723-4bdc-829f-d1a7600458f3 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] snapshot_file for this snap is: volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac305ef-6a01-446e-8b69-32e9a1673f59]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:42 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a Sep 28 19:13:42 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:42 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a" returned: 0 in 0.510s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9673d409-9723-4bdc-829f-d1a7600458f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:13:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c93649-345a-491a-a2cc-d1025ea32030]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:43 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 Sep 28 19:13:43 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:43 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3" returned: 0 in 0.490s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:43 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a Sep 28 19:13:43 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:43 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a" returned: 0 in 0.433s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:43 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a Sep 28 19:13:43 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:44 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3.9767433b-ea9b-4db1-b4fc-5c9cbaf4480a" returned: 0 in 0.271s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-9767433b-ea9b-4db1-b4fc-5c9cbaf4480a" released by "_delete_snapshot" :: held 1.897s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-9673d409-9723-4bdc-829f-d1a7600458f3" released by "delete_snapshot" :: held 1.946s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:44 devstack cinder-volume[86846]: WARNING cinder.quota [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-712288720 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-712288720, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:13:44 devstack cinder-volume[86846]: WARNING cinder.quota [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-712288720 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-712288720, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:13:44 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] Created reservations ['b4c321be-2aff-4e82-95a4-ad5e89ed8ca8', '3b6d5af8-554d-43cb-bc33-3b20b9098c2a', '65dcd0b6-9f3d-40c0-b39d-ee29bdf25a34', 'ce66fb49-bc3e-4996-a4d3-597dc455d9f1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6478578d-8f47-4598-9031-c8c64a284161 tempest-GroupSnapshotsTest-326392352 None] group_snapshot ed9732d3-31ad-4a16-8f55-59fbb5d67b45: deleted successfully Sep 28 19:13:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "cinder-quobyte-9673d409-9723-4bdc-829f-d1a7600458f3" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:13:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-9673d409-9723-4bdc-829f-d1a7600458f3" acquired by "delete_volume" :: waited 0.040s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:13:45 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1fedab-ad82-49c0-9395-46d95669f345]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:45 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 Sep 28 19:13:45 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:45 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3" returned: 0 in 0.441s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:45 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3 Sep 28 19:13:45 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:45 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9673d409-9723-4bdc-829f-d1a7600458f3" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Lock "cinder-quobyte-9673d409-9723-4bdc-829f-d1a7600458f3" released by "delete_volume" :: held 0.825s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:13:45 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Created reservations ['4e938d04-e2f5-4099-90df-9f8e5cd6e22b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:46 devstack cinder-volume[86846]: WARNING cinder.quota [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-712288720 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-712288720, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:13:46 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Created reservations ['85f6479d-dcb0-49d4-9f37-c3c0be5e443f', 'be777bbe-b814-4ec1-90b1-c726db6a2b25', 'cd87d7ab-8294-4eba-a88c-3fe84a65c0d8', '642e7d5a-2eed-4889-bed7-b9b4be410361'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:13:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:46 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:13:46 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:46 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:46 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:13:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d81eca15-41f0-446e-8ba8-4fca796968ae tempest-GroupSnapshotsTest-326392352 None] Delete group completed successfully. Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=133,cinder:INSERT=45,cinder:UPDATE=170,cinder:DELETE=6 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=166,cinder:UPDATE=152,cinder:INSERT=35,cinder:DELETE=7 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Flow 'volume_create_manager' (98c89abe-7797-48c5-80ab-c79724f96e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfcca82-4f39-484d-89fb-2364e0f809ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfcca82-4f39-484d-89fb-2364e0f809ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-274163648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b88785-82c0-4fb2-9947-1b79cb02ea0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08670c76e8f4908a02f5a27ff63d144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:54Z,use_quota=True,user_id='e38d996c5a85455095a390ce92205874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eee98d90-cb7b-4968-8ad5-5c3da2e900dd),volume_type_id=eee98d90-cb7b-4968-8ad5-5c3da2e900dd)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb42896-50be-485a-bd94-eadc89a44236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb42896-50be-485a-bd94-eadc89a44236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017f809d-c664-413f-8afd-f3c45fc6152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017f809d-c664-413f-8afd-f3c45fc6152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b88785-82c0-4fb2-9947-1b79cb02ea0a', 'volume_name': 'volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f3f4e1-8c06-4b61-9f9a-11064e7aa695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f3f4e1-8c06-4b61-9f9a-11064e7aa695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed19500a-7138-4f64-95f1-2fbd45fbce25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:53 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Volume 15b88785-82c0-4fb2-9947-1b79cb02ea0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a', 'volume_size': 1} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-274163648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b88785-82c0-4fb2-9947-1b79cb02ea0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08670c76e8f4908a02f5a27ff63d144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:54Z,use_quota=True,user_id='e38d996c5a85455095a390ce92205874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eee98d90-cb7b-4968-8ad5-5c3da2e900dd),volume_type_id=eee98d90-cb7b-4968-8ad5-5c3da2e900dd)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Creating volume 15b88785-82c0-4fb2-9947-1b79cb02ea0a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:13:53 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:13:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:53 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a 1073741824 Sep 28 19:13:53 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7c1da00a-56e3-465c-8312-042a7348d488 tempest-GroupSnapshotsV319Test-681558125 None] Group tempest-GroupSnapshotsV319Test-Group-1551534702: creating Sep 28 19:13:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7c1da00a-56e3-465c-8312-042a7348d488 tempest-GroupSnapshotsV319Test-681558125 None] Group tempest-GroupSnapshotsV319Test-Group-1551534702: created successfully Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Flow 'volume_create_manager' (d6480263-8c76-4764-bfba-067d1c243b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec7342e-06aa-4ce7-af72-626817e22dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7c1da00a-56e3-465c-8312-042a7348d488 tempest-GroupSnapshotsV319Test-681558125 None] Create group completed successfully. Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec7342e-06aa-4ce7-af72-626817e22dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-146539589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeeb5c05-0786-4255-aa22-ab6c7ff3bd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08670c76e8f4908a02f5a27ff63d144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:54Z,use_quota=True,user_id='e38d996c5a85455095a390ce92205874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e89e172c-c440-4486-a1ba-ea7880f79371),volume_type_id=e89e172c-c440-4486-a1ba-ea7880f79371)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fd8215-e03e-400c-93e5-398f0c8e6c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fd8215-e03e-400c-93e5-398f0c8e6c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48912d78-ce5b-4124-97bb-b08ea2b76eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48912d78-ce5b-4124-97bb-b08ea2b76eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeeb5c05-0786-4255-aa22-ab6c7ff3bd08', 'volume_name': 'volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31330c6-10c5-4177-acc6-73cc7ec5ae34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31330c6-10c5-4177-acc6-73cc7ec5ae34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b4e5f3-6067-4a41-9bca-256acbc43da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Volume aeeb5c05-0786-4255-aa22-ab6c7ff3bd08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08', 'volume_size': 1} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:54 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a 1073741824" returned: 0 in 0.636s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:54 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a Sep 28 19:13:54 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:54 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-146539589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeeb5c05-0786-4255-aa22-ab6c7ff3bd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08670c76e8f4908a02f5a27ff63d144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:54Z,use_quota=True,user_id='e38d996c5a85455095a390ce92205874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e89e172c-c440-4486-a1ba-ea7880f79371),volume_type_id=e89e172c-c440-4486-a1ba-ea7880f79371)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Creating volume aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:13:54 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed19500a-7138-4f64-95f1-2fbd45fbce25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26be62d8-29b9-4a89-bba5-52401da82a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:54 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 1073741824 Sep 28 19:13:54 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Volume volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a (15b88785-82c0-4fb2-9947-1b79cb02ea0a): created successfully Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26be62d8-29b9-4a89-bba5-52401da82a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Flow 'volume_create_manager' (98c89abe-7797-48c5-80ab-c79724f96e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-49d218ec-3f14-4c8e-8e4b-c63c4883daef tempest-TestInstancesWithCinderVolumes-947310033 None] Created volume successfully. Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Flow 'volume_create_manager' (e11fca24-34ce-4e59-bf10-360d87753b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b195d9ca-62cb-4ca6-ad03-5714a9aded5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b195d9ca-62cb-4ca6-ad03-5714a9aded5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-100496721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab66631b-986a-4cd6-8773-de1d602a9031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08670c76e8f4908a02f5a27ff63d144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:55Z,use_quota=True,user_id='e38d996c5a85455095a390ce92205874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3ee8475-f455-4501-b6cb-880d83b3e097),volume_type_id=a3ee8475-f455-4501-b6cb-880d83b3e097)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd826599-e8af-4583-b43c-bf390f9a6ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd826599-e8af-4583-b43c-bf390f9a6ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493107df-4185-4779-a849-f5b26c0f7809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 19:13:55 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 1073741824" returned: 0 in 0.558s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:55 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 Sep 28 19:13:55 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493107df-4185-4779-a849-f5b26c0f7809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab66631b-986a-4cd6-8773-de1d602a9031', 'volume_name': 'volume-ab66631b-986a-4cd6-8773-de1d602a9031', 'volume_size': 1, 'image_id': '3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--295835932', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b08670c76e8f4908a02f5a27ff63d144', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'created_at': datetime.datetime(2026, 9, 28, 17, 13, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3daf2ae1-75a0-47e7-961a-4f874ab2174f/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b417b6-697d-4e10-9513-a2e32156e2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b417b6-697d-4e10-9513-a2e32156e2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64c137f-3510-4adb-96c6-20bd5263255d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:55 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Volume ab66631b-986a-4cd6-8773-de1d602a9031: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab66631b-986a-4cd6-8773-de1d602a9031', 'volume_size': 1, 'image_id': '3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--295835932', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b08670c76e8f4908a02f5a27ff63d144', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'created_at': datetime.datetime(2026, 9, 28, 17, 13, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3daf2ae1-75a0-47e7-961a-4f874ab2174f/file', 'properties': {}}, 'image_service': } Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Trying to clone ab66631b-986a-4cd6-8773-de1d602a9031 from image 3daf2ae1-75a0-47e7-961a-4f874ab2174f at location (None, [{'url': 'file:///opt/stack/data/glance/images/3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 19:13:55 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b4e5f3-6067-4a41-9bca-256acbc43da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96ce132-9be4-4fcb-82ac-2005264ebadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:55 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Volume volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 (aeeb5c05-0786-4255-aa22-ab6c7ff3bd08): created successfully Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96ce132-9be4-4fcb-82ac-2005264ebadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Flow 'volume_create_manager' (d6480263-8c76-4764-bfba-067d1c243b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dfb5acba-f740-4816-a9d4-7d96e68fcf7b tempest-TestInstancesWithCinderVolumes-947310033 None] Created volume successfully. Sep 28 19:13:55 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Flow 'volume_create_manager' (bcb7d726-a9e0-4899-9a2f-0c6ebd5f6618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199f695e-788e-4c97-9ee1-8715db4cdc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199f695e-788e-4c97-9ee1-8715db4cdc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061749970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f527f4f1-9d0d-40ab-8f85-f981d43b7352,host='devstack@QuobyteHD#QuobyteHD',id=886ebbfe-d188-45b8-bd6b-080a93f60f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2501506e9e7a4be89938a535c4578ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:56Z,use_quota=True,user_id='b46a3dff383e46e9a707b3795cdd307a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a80cfd9b-c630-4178-98d8-dcae80c71f2f),volume_type_id=a80cfd9b-c630-4178-98d8-dcae80c71f2f)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3bc1c1-0d68-4797-a4ea-7f7af9683d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3bc1c1-0d68-4797-a4ea-7f7af9683d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebaa138-5c40-4d90-a90d-217121c84fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebaa138-5c40-4d90-a90d-217121c84fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '886ebbfe-d188-45b8-bd6b-080a93f60f9c', 'volume_name': 'volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e456c79-e5d7-497b-a39d-41a4db180d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e456c79-e5d7-497b-a39d-41a4db180d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8bad3c-cf5e-4ef6-93ff-6f761bb91d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Volume 886ebbfe-d188-45b8-bd6b-080a93f60f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c', 'volume_size': 1} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f527f4f1-9d0d-40ab-8f85-f981d43b7352,created_at=2026-09-28T17:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061749970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f527f4f1-9d0d-40ab-8f85-f981d43b7352,host='devstack@QuobyteHD#QuobyteHD',id=886ebbfe-d188-45b8-bd6b-080a93f60f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2501506e9e7a4be89938a535c4578ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:56Z,use_quota=True,user_id='b46a3dff383e46e9a707b3795cdd307a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a80cfd9b-c630-4178-98d8-dcae80c71f2f),volume_type_id=a80cfd9b-c630-4178-98d8-dcae80c71f2f)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Creating volume 886ebbfe-d188-45b8-bd6b-080a93f60f9c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:13:56 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:56 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c 1073741824 Sep 28 19:13:56 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:56 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c 1073741824" returned: 0 in 0.496s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:56 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c Sep 28 19:13:56 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:56 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8bad3c-cf5e-4ef6-93ff-6f761bb91d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcc683e-b5e0-432a-857f-b3ee8d5aa00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:13:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Volume volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c (886ebbfe-d188-45b8-bd6b-080a93f60f9c): created successfully Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcc683e-b5e0-432a-857f-b3ee8d5aa00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:13:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Flow 'volume_create_manager' (bcb7d726-a9e0-4899-9a2f-0c6ebd5f6618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:13:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3aebc333-c2e5-4155-88fe-024463f6e7d5 tempest-GroupSnapshotsV319Test-681558125 None] Created volume successfully. Sep 28 19:13:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] GroupSnapshot ee94356f-a0a1-487e-8bb3-251efab8ee48: creating. Sep 28 19:13:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Group snapshot ee94356f-a0a1-487e-8bb3-251efab8ee48: creating. {{(pid=86846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 19:13:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:13:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:13:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Creating offline snapshot 4def53ff-dec4-4290-8229-79eee6962069 of volume 886ebbfe-d188-45b8-bd6b-080a93f60f9c {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:13:57 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d730038-72d8-46e8-a9e9-768f6bc0bcfa]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:57 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c Sep 28 19:13:57 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:58 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c" returned: 0 in 0.407s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:58 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 1G Sep 28 19:13:58 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:58 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 1G" returned: 0 in 0.513s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:58 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 Sep 28 19:13:58 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:58 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:58 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:13:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:58 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 Sep 28 19:13:58 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:59 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069" returned: 0 in 0.264s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:59 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.info Sep 28 19:13:59 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD, size 20.69 MB, duration 3.86 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 19:13:59 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Image download 20.69 MB at 5.36 MB/s Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a2412e-83e7-441c-a581-a06654cbd3c5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:59 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.info" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:59 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:13:59 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.info Sep 28 19:13:59 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:59 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD Sep 28 19:13:59 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:13:59 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.info" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:13:59 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Temporary image 3daf2ae1-75a0-47e7-961a-4f874ab2174f is fetched for user e38d996c5a85455095a390ce92205874. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 19:13:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4998f6ff-8f9c-4b26-8ed4-8a4b002abccd tempest-GroupSnapshotsV319Test-681558125 None] group_snapshot ee94356f-a0a1-487e-8bb3-251efab8ee48: created successfully Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f89795-1050-46d1-86ff-a7a2488cfb3b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:13:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:00 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD Sep 28 19:14:00 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:00 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-100496721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab66631b-986a-4cd6-8773-de1d602a9031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08670c76e8f4908a02f5a27ff63d144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:13:55Z,use_quota=True,user_id='e38d996c5a85455095a390ce92205874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3ee8475-f455-4501-b6cb-880d83b3e097),volume_type_id=a3ee8475-f455-4501-b6cb-880d83b3e097)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Creating volume ab66631b-986a-4cd6-8773-de1d602a9031 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:14:00 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:00 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 1073741824 Sep 28 19:14:00 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:00 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 1073741824" returned: 0 in 0.475s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:00 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 Sep 28 19:14:00 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:01 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031" returned: 0 in 0.302s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Attempting download of 3daf2ae1-75a0-47e7-961a-4f874ab2174f ((None, [{'url': 'file:///opt/stack/data/glance/images/3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'metadata': {}}])) to volume ab66631b-986a-4cd6-8773-de1d602a9031. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9661e9dd-e36f-4ef0-b600-30c79547134a]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3daf2ae1-75a0-47e7-961a-4f874ab2174f_h_zcg6t3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] group_snapshot ee94356f-a0a1-487e-8bb3-251efab8ee48: deleting Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] group_snapshot ee94356f-a0a1-487e-8bb3-251efab8ee48: deleting {{(pid=86846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Acquiring lock "cinder-quobyte-886ebbfe-d188-45b8-bd6b-080a93f60f9c" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Lock "cinder-quobyte-886ebbfe-d188-45b8-bd6b-080a93f60f9c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Acquiring lock "cinder-quobyte-4def53ff-dec4-4290-8229-79eee6962069" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Lock "cinder-quobyte-4def53ff-dec4-4290-8229-79eee6962069" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Deleting offline snapshot 4def53ff-dec4-4290-8229-79eee6962069 of volume 886ebbfe-d188-45b8-bd6b-080a93f60f9c {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:14:01 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3daf2ae1-75a0-47e7-961a-4f874ab2174f_h_zcg6t3 Sep 28 19:14:01 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] snapshot_file for this snap is: volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d6b1ff-3bd1-47f5-9d38-6b2e1a492f8d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:01 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 Sep 28 19:14:01 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:01 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3daf2ae1-75a0-47e7-961a-4f874ab2174f_h_zcg6t3" returned: 0 in 0.428s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3daf2ae1-75a0-47e7-961a-4f874ab2174f_h_zcg6t3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:01 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3daf2ae1-75a0-47e7-961a-4f874ab2174f_h_zcg6t3 Sep 28 19:14:01 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:01 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069" returned: 0 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfdf2d3-fc2e-4739-b489-d6005d301b60]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:02 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:02 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c Sep 28 19:14:02 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3daf2ae1-75a0-47e7-961a-4f874ab2174f_h_zcg6t3" returned: 1 in 0.353s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3daf2ae1-75a0-47e7-961a-4f874ab2174f_h_zcg6t3' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b722b4d-a743-423e-aedb-de6d8766c672]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:02 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD Sep 28 19:14:02 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:02 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:02 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 Sep 28 19:14:02 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:02 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] 3daf2ae1-75a0-47e7-961a-4f874ab2174f was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:02 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 Sep 28 19:14:02 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:02 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069" returned: 0 in 0.430s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:02 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069 Sep 28 19:14:02 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:03 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c.4def53ff-dec4-4290-8229-79eee6962069" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Lock "cinder-quobyte-4def53ff-dec4-4290-8229-79eee6962069" released by "_delete_snapshot" :: held 1.784s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:14:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Lock "cinder-quobyte-886ebbfe-d188-45b8-bd6b-080a93f60f9c" released by "delete_snapshot" :: held 1.810s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:14:03 devstack cinder-volume[86846]: WARNING cinder.quota [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1229229854 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1229229854, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:14:03 devstack cinder-volume[86846]: WARNING cinder.quota [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1229229854 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1229229854, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:14:03 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] Created reservations ['ec228626-d3d7-4a15-b453-a52710939ba2', '8dd1a332-2071-4c46-95b6-83c2b38d1d4f', '5a1c63f7-c6b3-472d-83d5-d21e14e34174', '4d79b5ef-8d74-43c2-9c9c-dcf122bc3d92'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:14:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-79e3b75f-64d3-412f-96e4-720e31b8c920 tempest-GroupSnapshotsV319Test-681558125 None] group_snapshot ee94356f-a0a1-487e-8bb3-251efab8ee48: deleted successfully Sep 28 19:14:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Acquiring lock "cinder-quobyte-886ebbfe-d188-45b8-bd6b-080a93f60f9c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:14:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Lock "cinder-quobyte-886ebbfe-d188-45b8-bd6b-080a93f60f9c" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:14:04 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23181eb-c3ae-445b-b32e-e47ea9265e97]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:04 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c Sep 28 19:14:04 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:04 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c" returned: 0 in 0.554s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:04 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031" returned: 0 in 2.253s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:04 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3daf2ae1-75a0-47e7-961a-4f874ab2174f_2xqa_zpmdevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:14:04 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Converted 112.00 MB image at 49.65 MB/s Sep 28 19:14:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:04 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c Sep 28 19:14:04 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:04 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 1G Sep 28 19:14:04 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:04 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-886ebbfe-d188-45b8-bd6b-080a93f60f9c" returned: 0 in 0.273s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Lock "cinder-quobyte-886ebbfe-d188-45b8-bd6b-080a93f60f9c" released by "delete_volume" :: held 0.908s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Created reservations ['fd715cce-2604-47cc-a591-b12dcb181f6f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:14:05 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:05 devstack cinder-volume[86846]: WARNING cinder.quota [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1229229854 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1229229854, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 1G" returned: 0 in 0.373s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Downloaded image 3daf2ae1-75a0-47e7-961a-4f874ab2174f ((None, [{'url': 'file:///opt/stack/data/glance/images/3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'metadata': {}}])) to volume ab66631b-986a-4cd6-8773-de1d602a9031 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Temporary image 3daf2ae1-75a0-47e7-961a-4f874ab2174f for user e38d996c5a85455095a390ce92205874 is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Marking volume ab66631b-986a-4cd6-8773-de1d602a9031 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Copying metadata from image 3daf2ae1-75a0-47e7-961a-4f874ab2174f to ab66631b-986a-4cd6-8773-de1d602a9031. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Creating volume glance metadata for volume ab66631b-986a-4cd6-8773-de1d602a9031 backed by image 3daf2ae1-75a0-47e7-961a-4f874ab2174f with: {'image_id': '3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'image_name': 'tempest-scenario-img--295835932', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Created reservations ['bd1546c2-92f5-4fe0-a580-be8d34cefa0d', 'd16bf0ab-4286-4e5d-9d69-d2d52124e8ac', 'ddfe9c84-1bbb-4a45-a9bd-bc51bf0890c4', '6dc289a2-b7ea-4513-8737-7c6606ac24af'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64c137f-3510-4adb-96c6-20bd5263255d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab66631b-986a-4cd6-8773-de1d602a9031', 'volume_size': 1, 'image_id': '3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--295835932', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b08670c76e8f4908a02f5a27ff63d144', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3daf2ae1-75a0-47e7-961a-4f874ab2174f', 'created_at': datetime.datetime(2026, 9, 28, 17, 13, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3daf2ae1-75a0-47e7-961a-4f874ab2174f/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025d7ddc-5124-4142-969f-5e4392d02bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Volume volume-ab66631b-986a-4cd6-8773-de1d602a9031 (ab66631b-986a-4cd6-8773-de1d602a9031): created successfully Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025d7ddc-5124-4142-969f-5e4392d02bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Flow 'volume_create_manager' (e11fca24-34ce-4e59-bf10-360d87753b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:14:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-258f9c75-d6a8-49ae-bc80-580a50a3eed9 tempest-TestInstancesWithCinderVolumes-947310033 None] Created volume successfully. Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:05 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:14:05 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:05 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.298s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:05 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:14:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-88111013-2f0c-4194-b0e4-1e920ea371aa tempest-GroupSnapshotsV319Test-681558125 None] Delete group completed successfully. Sep 28 19:14:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-e00335f6-cd01-463f-be26-3147b594f5cf req-77c05b4a-ee2e-4de1-ba20-ae08766f9a81 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-e00335f6-cd01-463f-be26-3147b594f5cf req-77c05b4a-ee2e-4de1-ba20-ae08766f9a81 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-e00335f6-cd01-463f-be26-3147b594f5cf req-77c05b4a-ee2e-4de1-ba20-ae08766f9a81 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-e00335f6-cd01-463f-be26-3147b594f5cf req-77c05b4a-ee2e-4de1-ba20-ae08766f9a81 tempest-TestInstancesWithCinderVolumes-947310033 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-ab66631b-986a-4cd6-8773-de1d602a9031', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62eed02f-399b-4218-ad37-ef43d7689435', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:14:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-e00335f6-cd01-463f-be26-3147b594f5cf req-77c05b4a-ee2e-4de1-ba20-ae08766f9a81 tempest-TestInstancesWithCinderVolumes-947310033 None] attachment_update completed successfully. Sep 28 19:14:20 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=46,cinder:UPDATE=36,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:14:20 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=38,cinder:UPDATE=33,cinder:INSERT=15,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:14:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e42bc1f0-e483-4656-a84c-7211378077e3 tempest-GroupsTest-822040313 None] Group tempest-Group1-1068182590: creating Sep 28 19:14:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e42bc1f0-e483-4656-a84c-7211378077e3 tempest-GroupsTest-822040313 None] Group tempest-Group1-1068182590: created successfully Sep 28 19:14:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e42bc1f0-e483-4656-a84c-7211378077e3 tempest-GroupsTest-822040313 None] Create group completed successfully. Sep 28 19:14:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9fcf9a83-eb03-4a40-a351-414ea32f5317 tempest-GroupsTest-822040313 None] Group tempest-Group2-1907216044: creating Sep 28 19:14:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9fcf9a83-eb03-4a40-a351-414ea32f5317 tempest-GroupsTest-822040313 None] Group tempest-Group2-1907216044: created successfully Sep 28 19:14:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9fcf9a83-eb03-4a40-a351-414ea32f5317 tempest-GroupsTest-822040313 None] Create group completed successfully. Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Flow 'volume_create_manager' (27bb267d-50c8-4ca7-b956-0b204fa9b71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac13c7a-b2f4-4b5c-b3d4-55483d4e19a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac13c7a-b2f4-4b5c-b3d4-55483d4e19a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2097194247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0f6ec2e-5497-4126-a6b8-94069d13543a,host='devstack@QuobyteHD#QuobyteHD',id=49bc68d3-7e4d-400c-be97-e9121b90eb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b3927b1e9c4d85baffb5804ebc1331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:14:25Z,use_quota=True,user_id='2c60dfd5a134472e8c99661604408ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d108fcd-a843-499b-828f-79e42fb4f52c),volume_type_id=8d108fcd-a843-499b-828f-79e42fb4f52c)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264f8472-6933-4fb5-b8e9-92c5ba1435a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264f8472-6933-4fb5-b8e9-92c5ba1435a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcf6c06-abc2-45de-8cf8-2a3a908f21e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcf6c06-abc2-45de-8cf8-2a3a908f21e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49bc68d3-7e4d-400c-be97-e9121b90eb0c', 'volume_name': 'volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96de05a-1cd0-4ccb-848a-b011b659a3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96de05a-1cd0-4ccb-848a-b011b659a3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06aca86-b2d6-4d33-a5d2-b61e6dd9b08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Volume 49bc68d3-7e4d-400c-be97-e9121b90eb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c', 'volume_size': 1} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0f6ec2e-5497-4126-a6b8-94069d13543a,created_at=2026-09-28T17:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2097194247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0f6ec2e-5497-4126-a6b8-94069d13543a,host='devstack@QuobyteHD#QuobyteHD',id=49bc68d3-7e4d-400c-be97-e9121b90eb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b3927b1e9c4d85baffb5804ebc1331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:14:25Z,use_quota=True,user_id='2c60dfd5a134472e8c99661604408ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d108fcd-a843-499b-828f-79e42fb4f52c),volume_type_id=8d108fcd-a843-499b-828f-79e42fb4f52c)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Creating volume 49bc68d3-7e4d-400c-be97-e9121b90eb0c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:14:25 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:25 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c 1073741824 Sep 28 19:14:25 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:25 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c 1073741824" returned: 0 in 0.503s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:26 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c Sep 28 19:14:26 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:26 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:14:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06aca86-b2d6-4d33-a5d2-b61e6dd9b08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888fc1ea-1d0d-4689-a038-4e78d5eec0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:26 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Volume volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c (49bc68d3-7e4d-400c-be97-e9121b90eb0c): created successfully Sep 28 19:14:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888fc1ea-1d0d-4689-a038-4e78d5eec0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Flow 'volume_create_manager' (27bb267d-50c8-4ca7-b956-0b204fa9b71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:14:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7b148127-d76a-48da-b291-8955851ba417 tempest-GroupsTest-822040313 None] Created volume successfully. Sep 28 19:14:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Acquiring lock "cinder-quobyte-49bc68d3-7e4d-400c-be97-e9121b90eb0c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:14:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Lock "cinder-quobyte-49bc68d3-7e4d-400c-be97-e9121b90eb0c" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:14:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0cd2fe-24c9-4c27-9db3-c39dd865debf]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:27 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c Sep 28 19:14:27 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:27 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:27 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c Sep 28 19:14:27 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:28 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-49bc68d3-7e4d-400c-be97-e9121b90eb0c" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Lock "cinder-quobyte-49bc68d3-7e4d-400c-be97-e9121b90eb0c" released by "delete_volume" :: held 0.754s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Created reservations ['74180c1f-db3f-4a95-8cb9-0708df0dfd38'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:14:28 devstack cinder-volume[86846]: WARNING cinder.quota [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1112453867 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1112453867, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:14:28 devstack cinder-volume[86846]: WARNING cinder.quota [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1112453867 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1112453867, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Created reservations ['8598b837-ffc8-43bf-814f-a5371568db65', 'b7792d4e-08b5-4e9a-b96b-671ca29b4133', 'b418adeb-aad0-40d1-b9a4-575ab62282b1', 'fdbfe005-fbb6-4e8b-be9d-2569469e3f38'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:28 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:14:28 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2af6055a-a96a-43d2-a3d2-fdb818c3ad51 tempest-GroupsTest-822040313 None] Created reservations ['1817226f-c828-4200-b6dd-0a51ef4731e3'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:14:28 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:14:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3360635b-db99-48b5-9d78-7eb21832e24b tempest-GroupsTest-822040313 None] Delete group completed successfully. Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2af6055a-a96a-43d2-a3d2-fdb818c3ad51 tempest-GroupsTest-822040313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2af6055a-a96a-43d2-a3d2-fdb818c3ad51 tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2af6055a-a96a-43d2-a3d2-fdb818c3ad51 tempest-GroupsTest-822040313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2af6055a-a96a-43d2-a3d2-fdb818c3ad51 tempest-GroupsTest-822040313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2af6055a-a96a-43d2-a3d2-fdb818c3ad51 tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2af6055a-a96a-43d2-a3d2-fdb818c3ad51 tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:28 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:14:28 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:29 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2af6055a-a96a-43d2-a3d2-fdb818c3ad51 tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.263s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:29 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2af6055a-a96a-43d2-a3d2-fdb818c3ad51 tempest-GroupsTest-822040313 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:14:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2af6055a-a96a-43d2-a3d2-fdb818c3ad51 tempest-GroupsTest-822040313 None] Delete group completed successfully. Sep 28 19:14:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-19a638f9-496b-4b5c-b917-9be6f6bcd6a9 tempest-GroupsTest-822040313 None] Group tempest-GroupsTest-Group-752745883: creating Sep 28 19:14:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-19a638f9-496b-4b5c-b917-9be6f6bcd6a9 tempest-GroupsTest-822040313 None] Group tempest-GroupsTest-Group-752745883: created successfully Sep 28 19:14:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-19a638f9-496b-4b5c-b917-9be6f6bcd6a9 tempest-GroupsTest-822040313 None] Create group completed successfully. Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Flow 'volume_create_manager' (2ab74c23-d2b1-4627-8d2c-24f96f43a9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072274e5-8fbd-4cd2-ae5b-44b809af730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072274e5-8fbd-4cd2-ae5b-44b809af730b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1267383675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f6e2f17-39e5-4549-aa46-6b35808bb962,host='devstack@QuobyteHD#QuobyteHD',id=4a735140-8228-40e9-8b24-c194cbc8ed12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b3927b1e9c4d85baffb5804ebc1331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:14:32Z,use_quota=True,user_id='2c60dfd5a134472e8c99661604408ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61ab382d-5d01-4442-b973-664e12ffd27c),volume_type_id=61ab382d-5d01-4442-b973-664e12ffd27c)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bb3155-dc45-403b-844f-27e658986c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bb3155-dc45-403b-844f-27e658986c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ae50fa-ba70-489c-ab3b-69aa43775427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ae50fa-ba70-489c-ab3b-69aa43775427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a735140-8228-40e9-8b24-c194cbc8ed12', 'volume_name': 'volume-4a735140-8228-40e9-8b24-c194cbc8ed12', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98201f0-2867-4c5b-9db6-05ffc7723603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98201f0-2867-4c5b-9db6-05ffc7723603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2993f169-6ee7-4c6b-9991-e32ac9839362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Volume 4a735140-8228-40e9-8b24-c194cbc8ed12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a735140-8228-40e9-8b24-c194cbc8ed12', 'volume_size': 1} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f6e2f17-39e5-4549-aa46-6b35808bb962,created_at=2026-09-28T17:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1267383675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f6e2f17-39e5-4549-aa46-6b35808bb962,host='devstack@QuobyteHD#QuobyteHD',id=4a735140-8228-40e9-8b24-c194cbc8ed12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b3927b1e9c4d85baffb5804ebc1331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:14:32Z,use_quota=True,user_id='2c60dfd5a134472e8c99661604408ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61ab382d-5d01-4442-b973-664e12ffd27c),volume_type_id=61ab382d-5d01-4442-b973-664e12ffd27c)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Creating volume 4a735140-8228-40e9-8b24-c194cbc8ed12 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:14:32 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:32 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12 1073741824 Sep 28 19:14:32 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:32 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12 1073741824" returned: 0 in 0.639s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:33 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12 Sep 28 19:14:33 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:33 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12" returned: 0 in 0.326s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:14:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2993f169-6ee7-4c6b-9991-e32ac9839362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a735140-8228-40e9-8b24-c194cbc8ed12', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf70f80-e751-4e26-a566-da4b73978712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:33 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Volume volume-4a735140-8228-40e9-8b24-c194cbc8ed12 (4a735140-8228-40e9-8b24-c194cbc8ed12): created successfully Sep 28 19:14:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf70f80-e751-4e26-a566-da4b73978712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Flow 'volume_create_manager' (2ab74c23-d2b1-4627-8d2c-24f96f43a9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:14:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-029c47a3-68d5-474b-ad92-7fd7f8d42c0a tempest-GroupsTest-822040313 None] Created volume successfully. Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:34 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:14:34 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:34 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.290s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:14:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Flow 'volume_create_manager' (c39b2cfb-ed09-4895-8946-649cc8827cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6675f81f-a482-46f7-bf77-41ac3e51541e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6675f81f-a482-46f7-bf77-41ac3e51541e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-59186227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f6e2f17-39e5-4549-aa46-6b35808bb962,host='devstack@QuobyteHD#QuobyteHD',id=c04ea1a1-5101-4838-a7e8-f894aeb20cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b3927b1e9c4d85baffb5804ebc1331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:14:35Z,use_quota=True,user_id='2c60dfd5a134472e8c99661604408ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61ab382d-5d01-4442-b973-664e12ffd27c),volume_type_id=61ab382d-5d01-4442-b973-664e12ffd27c)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d3e949-b941-423e-adcc-4e6c7cf9f687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d3e949-b941-423e-adcc-4e6c7cf9f687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17347345-8c16-459d-89b0-e66d360a4c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17347345-8c16-459d-89b0-e66d360a4c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04ea1a1-5101-4838-a7e8-f894aeb20cfa', 'volume_name': 'volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df59cc88-b9e7-4401-8bde-3fc07b4fb991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df59cc88-b9e7-4401-8bde-3fc07b4fb991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4800c42-06dd-4bca-b0c5-48ee435e4a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Volume c04ea1a1-5101-4838-a7e8-f894aeb20cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa', 'volume_size': 1} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f6e2f17-39e5-4549-aa46-6b35808bb962,created_at=2026-09-28T17:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-59186227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f6e2f17-39e5-4549-aa46-6b35808bb962,host='devstack@QuobyteHD#QuobyteHD',id=c04ea1a1-5101-4838-a7e8-f894aeb20cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b3927b1e9c4d85baffb5804ebc1331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:14:35Z,use_quota=True,user_id='2c60dfd5a134472e8c99661604408ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61ab382d-5d01-4442-b973-664e12ffd27c),volume_type_id=61ab382d-5d01-4442-b973-664e12ffd27c)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Creating volume c04ea1a1-5101-4838-a7e8-f894aeb20cfa {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:14:35 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:35 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa 1073741824 Sep 28 19:14:35 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:35 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa 1073741824" returned: 0 in 0.481s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:36 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa Sep 28 19:14:36 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:36 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa" returned: 0 in 0.301s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:14:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4800c42-06dd-4bca-b0c5-48ee435e4a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedaf7b0-dae0-42de-8007-41e0007a3483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Volume volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa (c04ea1a1-5101-4838-a7e8-f894aeb20cfa): created successfully Sep 28 19:14:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedaf7b0-dae0-42de-8007-41e0007a3483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Flow 'volume_create_manager' (c39b2cfb-ed09-4895-8946-649cc8827cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:14:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c3bc228e-52e5-4451-934f-a4931e69c98f tempest-GroupsTest-822040313 None] Created volume successfully. Sep 28 19:14:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d0805d60-6071-4b21-b534-2e4bef3889ce tempest-GroupsTest-822040313 None] Update group completed successfully. Sep 28 19:14:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8d8caea3-a20b-4f43-ad2a-34065d644d72 tempest-GroupsTest-822040313 None] Update group completed successfully. Sep 28 19:14:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Acquiring lock "cinder-quobyte-4a735140-8228-40e9-8b24-c194cbc8ed12" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:14:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Lock "cinder-quobyte-4a735140-8228-40e9-8b24-c194cbc8ed12" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:14:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f0aa2d-c33f-4877-ab7a-9af09d0ba326]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:41 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12 Sep 28 19:14:41 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:41 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12" returned: 0 in 0.461s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:41 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12 Sep 28 19:14:41 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:41 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4a735140-8228-40e9-8b24-c194cbc8ed12" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Lock "cinder-quobyte-4a735140-8228-40e9-8b24-c194cbc8ed12" released by "delete_volume" :: held 0.797s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:14:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Acquiring lock "cinder-quobyte-c04ea1a1-5101-4838-a7e8-f894aeb20cfa" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:14:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Lock "cinder-quobyte-c04ea1a1-5101-4838-a7e8-f894aeb20cfa" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:14:41 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17c8ba1-12fa-4148-a984-cf43c5939d77]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:41 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa Sep 28 19:14:41 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:42 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa" returned: 0 in 0.422s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:42 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa Sep 28 19:14:42 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:42 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c04ea1a1-5101-4838-a7e8-f894aeb20cfa" returned: 0 in 0.283s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Lock "cinder-quobyte-c04ea1a1-5101-4838-a7e8-f894aeb20cfa" released by "delete_volume" :: held 0.761s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Created reservations ['0b8d6314-0de9-4a85-973a-e611b407a91a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:14:42 devstack cinder-volume[86846]: WARNING cinder.quota [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1006897339 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1006897339, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:14:42 devstack cinder-volume[86846]: WARNING cinder.quota [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1006897339 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1006897339, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Created reservations ['9ecbd3f1-df23-4bb1-8689-6a4d2c15dfea', '239e2b5a-5ec8-4fb7-99bf-c3df88cc7763', 'acade1e5-4c5f-4455-bfb1-e252aeeadd22', '9a9da8e0-2326-4b6a-8bd6-42d3cb8adee5'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Created reservations ['55b0c9e8-62cc-4532-b3e6-352f2aa3d00a', 'e14f7071-f08c-4d18-bf66-d804cafc4cac', '29961cf9-0be7-4c3c-be3c-1028fa02e724', '1434b095-b790-44bb-be5b-73fea2744db4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:42 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:14:42 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:43 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:43 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:14:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-204c278f-8a3d-41c4-bf77-a323b3ef0102 tempest-GroupsTest-822040313 None] Delete group completed successfully. Sep 28 19:14:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-575ef34a-f695-4e92-9792-0a73bcd7d353 req-cd812b74-de76-46e4-9df5-33823a8763d2 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-575ef34a-f695-4e92-9792-0a73bcd7d353 req-cd812b74-de76-46e4-9df5-33823a8763d2 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-575ef34a-f695-4e92-9792-0a73bcd7d353 req-cd812b74-de76-46e4-9df5-33823a8763d2 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-575ef34a-f695-4e92-9792-0a73bcd7d353 req-cd812b74-de76-46e4-9df5-33823a8763d2 tempest-TestInstancesWithCinderVolumes-947310033 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'daf699c0-f07f-4cdd-a4cd-494d782e566d', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:14:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-575ef34a-f695-4e92-9792-0a73bcd7d353 req-cd812b74-de76-46e4-9df5-33823a8763d2 tempest-TestInstancesWithCinderVolumes-947310033 None] attachment_update completed successfully. Sep 28 19:14:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-ddaf7218-9359-492f-b6a8-24e5f681ae92 req-bd74416a-1fee-4729-b3ad-7d4f0b46892d tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-ddaf7218-9359-492f-b6a8-24e5f681ae92 req-bd74416a-1fee-4729-b3ad-7d4f0b46892d tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-ddaf7218-9359-492f-b6a8-24e5f681ae92 req-bd74416a-1fee-4729-b3ad-7d4f0b46892d tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-ddaf7218-9359-492f-b6a8-24e5f681ae92 req-bd74416a-1fee-4729-b3ad-7d4f0b46892d tempest-TestInstancesWithCinderVolumes-947310033 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98d49ff0-33fe-4620-83aa-3ba941683e7a', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:14:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-ddaf7218-9359-492f-b6a8-24e5f681ae92 req-bd74416a-1fee-4729-b3ad-7d4f0b46892d tempest-TestInstancesWithCinderVolumes-947310033 None] attachment_update completed successfully. Sep 28 19:14:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5c1a323d-03f1-48e0-814a-754db7e132e4 tempest-GroupsV314Test-1089975591 None] Group tempest-GroupsV314Test-Group-846789068: creating Sep 28 19:14:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5c1a323d-03f1-48e0-814a-754db7e132e4 tempest-GroupsV314Test-1089975591 None] Group tempest-GroupsV314Test-Group-846789068: created successfully Sep 28 19:14:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5c1a323d-03f1-48e0-814a-754db7e132e4 tempest-GroupsV314Test-1089975591 None] Create group completed successfully. Sep 28 19:14:51 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:14:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Flow 'volume_create_manager' (d8774610-efd7-4608-979f-89cc55381278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:14:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ae01de-faff-4fcf-af28-c06a7b329425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ae01de-faff-4fcf-af28-c06a7b329425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1183474530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d04b59b-da5e-406b-a505-092ffcfd4680,host='devstack@QuobyteHD#QuobyteHD',id=6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7deee9088744e0991514352ec1aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:14:52Z,use_quota=True,user_id='818203d9a0f24c989561195adc1b0b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b401dac3-a35f-4c6f-b3b1-d31b1ae4d250),volume_type_id=b401dac3-a35f-4c6f-b3b1-d31b1ae4d250)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a6fbd9-91f9-4c26-b37c-701e5b8605f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a6fbd9-91f9-4c26-b37c-701e5b8605f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b359314f-5104-4e8d-8d68-2b52ac7e45ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b359314f-5104-4e8d-8d68-2b52ac7e45ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce', 'volume_name': 'volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c47ea33-5077-4d8f-a211-8509c148e65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c47ea33-5077-4d8f-a211-8509c148e65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e81cb4-1f50-4744-9234-636063fd2c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:52 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Volume 6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce', 'volume_size': 1} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d04b59b-da5e-406b-a505-092ffcfd4680,created_at=2026-09-28T17:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1183474530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d04b59b-da5e-406b-a505-092ffcfd4680,host='devstack@QuobyteHD#QuobyteHD',id=6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7deee9088744e0991514352ec1aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:14:52Z,use_quota=True,user_id='818203d9a0f24c989561195adc1b0b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b401dac3-a35f-4c6f-b3b1-d31b1ae4d250),volume_type_id=b401dac3-a35f-4c6f-b3b1-d31b1ae4d250)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Creating volume 6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:14:52 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:52 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce 1073741824 Sep 28 19:14:52 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:52 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce 1073741824" returned: 0 in 0.536s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:52 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce Sep 28 19:14:52 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:52 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e81cb4-1f50-4744-9234-636063fd2c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f901b23-d02f-4f99-a28f-194eecff558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:14:53 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Volume volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce (6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce): created successfully Sep 28 19:14:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f901b23-d02f-4f99-a28f-194eecff558f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:14:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Flow 'volume_create_manager' (d8774610-efd7-4608-979f-89cc55381278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:14:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f0f38a6c-ed72-482d-a1d5-a47ecb1415f3 tempest-GroupsV314Test-1089975591 None] Created volume successfully. Sep 28 19:14:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:53 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Cloning volume 6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce to volume 4c05be07-42f0-4669-855a-97385a2d62c3 Sep 28 19:14:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Creating offline snapshot 461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 of volume 6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:14:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb56dc8a-ac81-4fa7-9c02-fea0c5610f39]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:54 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce Sep 28 19:14:54 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:54 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce" returned: 0 in 0.467s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:54 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 1G Sep 28 19:14:54 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:54 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 1G" returned: 0 in 0.461s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:54 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 Sep 28 19:14:54 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:55 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:55 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:14:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:55 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 Sep 28 19:14:55 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:55 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6" returned: 0 in 0.299s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:55 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.info Sep 28 19:14:55 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:55 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.info" returned: 0 in 0.321s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:55 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:14:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:55 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.info Sep 28 19:14:55 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-e49fb8a9-4a7f-4a3b-a9e6-dfc8a358dad1 req-9ae940fb-b5e9-40ed-9458-e4384f9fcd8f tempest-TestInstancesWithCinderVolumes-947310033 None] Terminate volume connection completed successfully. Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-e49fb8a9-4a7f-4a3b-a9e6-dfc8a358dad1 req-9ae940fb-b5e9-40ed-9458-e4384f9fcd8f tempest-TestInstancesWithCinderVolumes-947310033 None] Deleting attachment daf699c0-f07f-4cdd-a4cd-494d782e566d. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:14:56 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.info" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Acquiring lock "cinder-quobyte-4c05be07-42f0-4669-855a-97385a2d62c3" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Lock "cinder-quobyte-4c05be07-42f0-4669-855a-97385a2d62c3" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] snapshot: 461db92f-3ae8-4c0c-82c5-cf1338b4f9e6, volume: 4c05be07-42f0-4669-855a-97385a2d62c3, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b912605-bbe6-4bcd-b503-4159fb08fc89]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:56 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 Sep 28 19:14:56 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:56 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6" returned: 0 in 0.433s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db32b3-c5b6-48d1-941b-71cda78c2a2f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "cinder-15b88785-82c0-4fb2-9947-1b79cb02ea0a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-15b88785-82c0-4fb2-9947-1b79cb02ea0a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "cinder-quobyte-15b88785-82c0-4fb2-9947-1b79cb02ea0a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-quobyte-15b88785-82c0-4fb2-9947-1b79cb02ea0a" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:14:56 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce Sep 28 19:14:56 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5ad695-d7d8-4f9c-9030-6042cdc7b4a0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:14:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:57 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a Sep 28 19:14:57 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:57 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce" returned: 0 in 0.454s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:57 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 Sep 28 19:14:57 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:57 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:57 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a Sep 28 19:14:57 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:57 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-15b88785-82c0-4fb2-9947-1b79cb02ea0a" returned: 0 in 0.336s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-quobyte-15b88785-82c0-4fb2-9947-1b79cb02ea0a" released by "delete_volume" :: held 0.836s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:14:57 devstack cinder-volume[86846]: WARNING cinder.quota [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1023553450-390760404 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1023553450-390760404, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:14:57 devstack cinder-volume[86846]: WARNING cinder.quota [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1023553450-390760404 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1023553450-390760404, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Created reservations ['7958ff59-65a7-466e-85d1-0e00f622bcf9', '6060b0d4-8ebb-47e9-8af0-11451c7611cb', 'aff6b022-db6f-4f92-bd9a-613295d8227e', 'ec4bd0d8-de82-49c8-b00c-f6ba2b824dab'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:14:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:14:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:14:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:14:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:14:58 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:14:58 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:14:58 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Sep 28 19:14:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:14:58 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:14:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Deleted volume successfully. Sep 28 19:14:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-91d4cdf8-1058-4ace-8e45-fb742869e292 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-15b88785-82c0-4fb2-9947-1b79cb02ea0a-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-d9e64a2e-a173-4faf-a1d3-f47c5265fe32 req-ec3ff399-bd4b-4777-9b2a-b0f3c21b31f5 tempest-TestInstancesWithCinderVolumes-947310033 None] Terminate volume connection completed successfully. Sep 28 19:15:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-d9e64a2e-a173-4faf-a1d3-f47c5265fe32 req-ec3ff399-bd4b-4777-9b2a-b0f3c21b31f5 tempest-TestInstancesWithCinderVolumes-947310033 None] Deleting attachment 98d49ff0-33fe-4620-83aa-3ba941683e7a. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:15:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "cinder-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:15:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:15:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "cinder-quobyte-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:15:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-quobyte-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08" acquired by "delete_volume" :: waited 0.073s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:15:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e135744c-2dc7-4b2b-92fb-55273e359974]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:03 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 Sep 28 19:15:03 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:04 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08" returned: 0 in 0.766s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:04 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08 Sep 28 19:15:04 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:04 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08" returned: 0 in 0.457s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-quobyte-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08" released by "delete_volume" :: held 1.376s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:04 devstack cinder-volume[86846]: WARNING cinder.quota [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1488374520-164788593 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1488374520-164788593, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:15:04 devstack cinder-volume[86846]: WARNING cinder.quota [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1488374520-164788593 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1488374520-164788593, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:15:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Created reservations ['411a8003-c659-4b61-bc7d-41cf7cfde968', 'e310d93b-578e-4128-8edd-e99f1047e4cb', 'b501a0de-a894-48fe-a81a-9c2d43f00bba', 'ae35d355-d22e-4d8f-96cf-24e442a4082a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:05 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:15:05 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:05 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3" returned: 0 in 7.929s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:15:05 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Converted 1024.00 MB image at 129.12 MB/s Sep 28 19:15:05 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:05 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 Sep 28 19:15:05 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:05 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:15:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Deleted volume successfully. Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eba2c992-8dfa-43c5-bfee-c1a81b346a03 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-aeeb5c05-0786-4255-aa22-ab6c7ff3bd08-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:05 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Lock "cinder-quobyte-4c05be07-42f0-4669-855a-97385a2d62c3" released by "_copy_volume_from_snapshot" :: held 9.236s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Acquiring lock "cinder-quobyte-461db92f-3ae8-4c0c-82c5-cf1338b4f9e6" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Lock "cinder-quobyte-461db92f-3ae8-4c0c-82c5-cf1338b4f9e6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Deleting offline snapshot 461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 of volume 6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] snapshot_file for this snap is: volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[91194416-4422-4854-87ee-69b7ad15c9ad]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:05 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 Sep 28 19:15:05 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:06 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:15:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde5bf20-a237-4ad3-af1f-c71c03d7c7dc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:06 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce Sep 28 19:15:06 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:06 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce" returned: 0 in 0.640s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:06 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 Sep 28 19:15:06 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:07 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:07 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6 Sep 28 19:15:07 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:07 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce.461db92f-3ae8-4c0c-82c5-cf1338b4f9e6" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Lock "cinder-quobyte-461db92f-3ae8-4c0c-82c5-cf1338b4f9e6" released by "_delete_snapshot" :: held 1.897s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.567s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4429a2ec-b84e-4a0a-baa2-12d35cf5b49e tempest-GroupsV314Test-1089975591 None] Create group from source-group-8d04b59b-da5e-406b-a505-092ffcfd4680 completed successfully. Sep 28 19:15:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Acquiring lock "cinder-quobyte-4c05be07-42f0-4669-855a-97385a2d62c3" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:15:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Lock "cinder-quobyte-4c05be07-42f0-4669-855a-97385a2d62c3" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:15:08 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d8bd78-bbe7-4c75-85ee-d689786f8d90]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:08 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 Sep 28 19:15:08 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:09 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3" returned: 0 in 0.475s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:09 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3 Sep 28 19:15:09 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-092747fe-9b0d-488c-abfb-53bad3eee16d req-5b4bca34-aa1d-4cae-a93f-ec5d9be0feda tempest-TestInstancesWithCinderVolumes-947310033 None] Terminate volume connection completed successfully. Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-092747fe-9b0d-488c-abfb-53bad3eee16d req-5b4bca34-aa1d-4cae-a93f-ec5d9be0feda tempest-TestInstancesWithCinderVolumes-947310033 None] Deleting attachment 62eed02f-399b-4218-ad37-ef43d7689435. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:15:09 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4c05be07-42f0-4669-855a-97385a2d62c3" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Lock "cinder-quobyte-4c05be07-42f0-4669-855a-97385a2d62c3" released by "delete_volume" :: held 0.838s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Created reservations ['b97f052a-7840-4401-8344-9d085a784d30'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:15:09 devstack cinder-volume[86846]: WARNING cinder.quota [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1088647679 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1088647679, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:15:09 devstack cinder-volume[86846]: WARNING cinder.quota [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1088647679 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1088647679, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Created reservations ['a5688629-c37b-4b79-a3f8-2856f39ec719', '274b2ee0-2f4a-462f-9977-665144c58ff0', 'b40470a4-8d23-4ae4-9867-fe020c0e6552', 'f39feb5d-2acc-4b5b-a5c6-73333103a957'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:09 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:15:09 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "cinder-ab66631b-986a-4cd6-8773-de1d602a9031-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:15:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-ab66631b-986a-4cd6-8773-de1d602a9031-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "cinder-quobyte-ab66631b-986a-4cd6-8773-de1d602a9031" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:15:10 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.353s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-quobyte-ab66631b-986a-4cd6-8773-de1d602a9031" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:15:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f35c080c-dc78-495b-95bd-4348d423fec3 tempest-GroupsV314Test-1089975591 None] Delete group completed successfully. Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[83528fcd-6afb-4174-bd13-c4273a8c01b9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Acquiring lock "cinder-quobyte-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:15:10 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 Sep 28 19:15:10 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Lock "cinder-quobyte-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f949bbb-fbfa-4b18-8268-f66c14ba1e3a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:10 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce Sep 28 19:15:10 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:10 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031" returned: 0 in 0.449s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:10 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031 Sep 28 19:15:10 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:10 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce" returned: 0 in 0.397s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:10 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce Sep 28 19:15:10 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:10 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ab66631b-986a-4cd6-8773-de1d602a9031" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-quobyte-ab66631b-986a-4cd6-8773-de1d602a9031" released by "delete_volume" :: held 0.788s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:10 devstack cinder-volume[86846]: WARNING cinder.quota [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-326644402-1373485614 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-326644402-1373485614, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:15:10 devstack cinder-volume[86846]: WARNING cinder.quota [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-326644402-1373485614 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-326644402-1373485614, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Created reservations ['75b9bbb8-6ce8-4650-ad3b-7d6d4fc624e6', '9d095082-9190-43ac-8a47-e7a8190019a9', '75af6327-ccf7-4410-9d85-002d3ddb2e12', '1feceea9-e375-4c87-aacd-d2a36d3ab8ef'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:10 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce" returned: 0 in 0.283s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:11 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:15:11 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Lock "cinder-quobyte-6c0fd2e4-e0b2-4f69-a6f6-3e9d254ec4ce" released by "delete_volume" :: held 0.783s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Created reservations ['7860eb19-089c-4131-a383-27b5d5dea458'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Created reservations ['df981a79-9460-4e47-b073-41e6abd5469e', '347d5c22-c055-467b-b62c-83dec202818a', '557b353a-8002-4b08-bd76-a5f8a59d8e3f', '02e3dada-8ee6-4992-84ee-5a67a1b62f44'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:15:11 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:15:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Deleted volume successfully. Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c89283c-b440-4b7a-8716-c32b25c0e4c4 tempest-TestInstancesWithCinderVolumes-947310033 None] Lock "cinder-ab66631b-986a-4cd6-8773-de1d602a9031-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:11 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:15:11 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:11 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:11 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:15:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f7992b86-9545-45f3-b9e4-d6f98f843576 tempest-GroupsV314Test-1089975591 None] Delete group completed successfully. Sep 28 19:15:21 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=95,cinder:UPDATE=100,cinder:INSERT=22,cinder:DELETE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:15:21 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=104,cinder:SELECT=104,cinder:INSERT=21,cinder:DELETE=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Flow 'volume_create_manager' (32f9125f-9d5a-49cd-8546-e13e1931b403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a8ab38-6a61-4c2f-b816-2b7f62939d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a8ab38-6a61-4c2f-b816-2b7f62939d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-480231539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be7165a-ac85-4777-a041-b85d034f9d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbaa940c7d614b939103fa8f34da56ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:15:30Z,use_quota=True,user_id='8f7bfba0253f4ab28500bb722d4ede61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(761337f6-c2f6-46f6-9377-6a4b96ce063f),volume_type_id=761337f6-c2f6-46f6-9377-6a4b96ce063f)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c4c1fd-e0fd-4581-a034-67d78363e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c4c1fd-e0fd-4581-a034-67d78363e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b58e41-51b3-4431-8ff1-1e67afdd2792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b58e41-51b3-4431-8ff1-1e67afdd2792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be7165a-ac85-4777-a041-b85d034f9d01', 'volume_name': 'volume-9be7165a-ac85-4777-a041-b85d034f9d01', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add86e6a-f92b-4a0a-a88f-5e42eaeb7e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add86e6a-f92b-4a0a-a88f-5e42eaeb7e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5298f09-3ad7-449a-9ff6-f4c4c0708b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:30 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Volume 9be7165a-ac85-4777-a041-b85d034f9d01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be7165a-ac85-4777-a041-b85d034f9d01', 'volume_size': 1} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-480231539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be7165a-ac85-4777-a041-b85d034f9d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbaa940c7d614b939103fa8f34da56ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:15:30Z,use_quota=True,user_id='8f7bfba0253f4ab28500bb722d4ede61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(761337f6-c2f6-46f6-9377-6a4b96ce063f),volume_type_id=761337f6-c2f6-46f6-9377-6a4b96ce063f)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Creating volume 9be7165a-ac85-4777-a041-b85d034f9d01 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:15:30 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:30 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01 1073741824 Sep 28 19:15:30 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:30 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01 1073741824" returned: 0 in 0.477s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:30 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01 Sep 28 19:15:30 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:31 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01" returned: 0 in 0.394s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:15:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5298f09-3ad7-449a-9ff6-f4c4c0708b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be7165a-ac85-4777-a041-b85d034f9d01', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35eb5ef-8698-47a0-80ef-9f7fc66e9e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Volume volume-9be7165a-ac85-4777-a041-b85d034f9d01 (9be7165a-ac85-4777-a041-b85d034f9d01): created successfully Sep 28 19:15:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35eb5ef-8698-47a0-80ef-9f7fc66e9e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Flow 'volume_create_manager' (32f9125f-9d5a-49cd-8546-e13e1931b403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:15:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c2baee42-064b-4a4d-8c92-482a3a3b68c0 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Created volume successfully. Sep 28 19:15:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf6a8bc4-9755-41e4-9d4e-f3f423d1a098 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf6a8bc4-9755-41e4-9d4e-f3f423d1a098 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf6a8bc4-9755-41e4-9d4e-f3f423d1a098 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:15:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf6a8bc4-9755-41e4-9d4e-f3f423d1a098 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:15:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf6a8bc4-9755-41e4-9d4e-f3f423d1a098 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf6a8bc4-9755-41e4-9d4e-f3f423d1a098 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:32 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:15:32 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:33 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf6a8bc4-9755-41e4-9d4e-f3f423d1a098 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:33 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-cf6a8bc4-9755-41e4-9d4e-f3f423d1a098 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:15:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cf6a8bc4-9755-41e4-9d4e-f3f423d1a098 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Retype volume completed successfully. Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Acquiring lock "cinder-9be7165a-ac85-4777-a041-b85d034f9d01-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "cinder-9be7165a-ac85-4777-a041-b85d034f9d01-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Acquiring lock "cinder-quobyte-9be7165a-ac85-4777-a041-b85d034f9d01" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "cinder-quobyte-9be7165a-ac85-4777-a041-b85d034f9d01" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5898cc-ed98-43c6-9c94-65b3c5f06afd]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:34 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01 Sep 28 19:15:34 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:34 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:15:34 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:34 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01" returned: 0 in 0.454s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:34 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01 Sep 28 19:15:34 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:34 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.313s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:15:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:15:35 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9be7165a-ac85-4777-a041-b85d034f9d01" returned: 0 in 0.332s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "cinder-quobyte-9be7165a-ac85-4777-a041-b85d034f9d01" released by "delete_volume" :: held 0.840s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:35 devstack cinder-volume[86846]: WARNING cinder.quota [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:15:35 devstack cinder-volume[86846]: WARNING cinder.quota [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Created reservations ['8741d6a0-03d0-47d9-bae2-5eed98ee83fd', '9825fac2-367b-4e57-810b-36884df801bc', '2b46c731-3d19-4f5a-93c9-36d7d3465307', '3c3a5d83-d45a-475d-abd5-2b1dcae2b7b4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:35 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:15:35 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:35 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:15:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Deleted volume successfully. Sep 28 19:15:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdc89606-e4e8-45e0-87da-132f9713e626 tempest-VolumeRetypeWithoutMigrationTest-18708390 None] Lock "cinder-9be7165a-ac85-4777-a041-b85d034f9d01-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:15:45 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=15,cinder:UPDATE=17,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:15:45 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:15:53 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:15:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Flow 'volume_create_manager' (7c2d9a60-6b89-4d2f-bb8d-1c98331ada2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:15:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5573a024-a986-4b3f-8110-df1dce772d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5573a024-a986-4b3f-8110-df1dce772d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1928514326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2660c029-cce8-4879-9717-28c179f8c24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1af2c4ec0645bc9cbbc7a35c27c539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:15:54Z,use_quota=True,user_id='9a0a61aa71fe4cc2adfe7d70fd0f1ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999969f4-503a-4893-ac60-08a603504407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999969f4-503a-4893-ac60-08a603504407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6002c86c-5fef-4c2e-a3de-143223161cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:53 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 19:15:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6002c86c-5fef-4c2e-a3de-143223161cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2660c029-cce8-4879-9717-28c179f8c24e', 'volume_name': 'volume-2660c029-cce8-4879-9717-28c179f8c24e', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219d8554-073f-43ae-878a-977af1f7e9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219d8554-073f-43ae-878a-977af1f7e9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb508b06-0473-48bb-922b-0392062adab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Volume 2660c029-cce8-4879-9717-28c179f8c24e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2660c029-cce8-4879-9717-28c179f8c24e', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 19:15:54 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Trying to clone 2660c029-cce8-4879-9717-28c179f8c24e from image 62ee51ad-b6ed-458d-a726-fccffd745d46 at location (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 19:15:54 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 19:15:54 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Image download 20.69 MB at 20.69 MB/s Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d7589b-e63c-4611-8fe9-14620391792b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:55 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD Sep 28 19:15:55 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:55 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Temporary image 62ee51ad-b6ed-458d-a726-fccffd745d46 is fetched for user 9a0a61aa71fe4cc2adfe7d70fd0f1ee9. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea58241-87b6-4044-8053-a410af8cc001]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:55 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD Sep 28 19:15:55 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:55 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1928514326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2660c029-cce8-4879-9717-28c179f8c24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1af2c4ec0645bc9cbbc7a35c27c539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:15:54Z,use_quota=True,user_id='9a0a61aa71fe4cc2adfe7d70fd0f1ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Creating volume 2660c029-cce8-4879-9717-28c179f8c24e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:15:55 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:15:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:55 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e 1073741824 Sep 28 19:15:55 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:56 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e 1073741824" returned: 0 in 0.575s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:56 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e Sep 28 19:15:56 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:56 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e" returned: 0 in 0.275s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:15:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:56 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Attempting download of 62ee51ad-b6ed-458d-a726-fccffd745d46 ((None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}])) to volume 2660c029-cce8-4879-9717-28c179f8c24e. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 19:15:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d3eac-9aa4-4889-aa78-ebf51292b4e9]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_utj3zwpx {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:56 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_utj3zwpx Sep 28 19:15:56 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:57 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_utj3zwpx" returned: 0 in 0.376s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_utj3zwpx {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:57 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_utj3zwpx Sep 28 19:15:57 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:57 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_utj3zwpx" returned: 1 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_utj3zwpx' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:15:57 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5864f2-c9ac-4aa2-8413-c9e9174a5a8b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:15:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:57 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD Sep 28 19:15:57 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:57 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:57 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] 62ee51ad-b6ed-458d-a726-fccffd745d46 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 19:15:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:58 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e Sep 28 19:15:58 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Flow 'volume_create_manager' (f9ba6902-a439-47ed-aa59-33e64eeb65a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cbf1ce-cc66-48b6-90a3-62a63c41bd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cbf1ce-cc66-48b6-90a3-62a63c41bd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-205315035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43dd237-9bcd-455f-8e18-e72779c59b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8e14dd354d2490f184d501d68f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:15:58Z,use_quota=True,user_id='89e7c013721346f5bfb9b611319e6e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0abf3a-ca00-4934-b7f5-e4d0e93751a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0abf3a-ca00-4934-b7f5-e4d0e93751a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3542ea-7079-49e6-b888-ae3737971ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3542ea-7079-49e6-b888-ae3737971ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f43dd237-9bcd-455f-8e18-e72779c59b17', 'volume_name': 'volume-f43dd237-9bcd-455f-8e18-e72779c59b17', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac6e305-2f1e-4d09-b4b7-18bb2fa93910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac6e305-2f1e-4d09-b4b7-18bb2fa93910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e961e8-b04a-48c3-b329-5ec307cc86b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Volume f43dd237-9bcd-455f-8e18-e72779c59b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f43dd237-9bcd-455f-8e18-e72779c59b17', 'volume_size': 1} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-205315035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43dd237-9bcd-455f-8e18-e72779c59b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8e14dd354d2490f184d501d68f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:15:58Z,use_quota=True,user_id='89e7c013721346f5bfb9b611319e6e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Creating volume f43dd237-9bcd-455f-8e18-e72779c59b17 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:15:58 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:15:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:58 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17 1073741824 Sep 28 19:15:58 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:59 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17 1073741824" returned: 0 in 0.552s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:15:59 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17 Sep 28 19:15:59 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:15:59 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Sep 28 19:15:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:15:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:15:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:15:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e961e8-b04a-48c3-b329-5ec307cc86b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f43dd237-9bcd-455f-8e18-e72779c59b17', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ad07c1-4612-47c9-9530-befb86a68590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:15:59 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Volume volume-f43dd237-9bcd-455f-8e18-e72779c59b17 (f43dd237-9bcd-455f-8e18-e72779c59b17): created successfully Sep 28 19:15:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ad07c1-4612-47c9-9530-befb86a68590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:15:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Flow 'volume_create_manager' (f9ba6902-a439-47ed-aa59-33e64eeb65a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:15:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ae9a8b1c-0cff-42af-b02f-d3c18a4ae3d3 tempest-VolumesTransfersV355Test-803631021 None] Created volume successfully. Sep 28 19:16:00 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e" returned: 0 in 2.053s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_cxv_ezufdevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:16:00 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Converted 112.00 MB image at 54.51 MB/s Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:00 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e 1G Sep 28 19:16:00 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:00 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e 1G" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Downloaded image 62ee51ad-b6ed-458d-a726-fccffd745d46 ((None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}])) to volume 2660c029-cce8-4879-9717-28c179f8c24e successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Temporary image 62ee51ad-b6ed-458d-a726-fccffd745d46 for user 9a0a61aa71fe4cc2adfe7d70fd0f1ee9 is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Marking volume 2660c029-cce8-4879-9717-28c179f8c24e as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Copying metadata from image 62ee51ad-b6ed-458d-a726-fccffd745d46 to 2660c029-cce8-4879-9717-28c179f8c24e. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Creating volume glance metadata for volume 2660c029-cce8-4879-9717-28c179f8c24e backed by image 62ee51ad-b6ed-458d-a726-fccffd745d46 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb508b06-0473-48bb-922b-0392062adab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2660c029-cce8-4879-9717-28c179f8c24e', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca30ef0-8018-4165-a033-9d729759fefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Volume volume-2660c029-cce8-4879-9717-28c179f8c24e (2660c029-cce8-4879-9717-28c179f8c24e): created successfully Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca30ef0-8018-4165-a033-9d729759fefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Flow 'volume_create_manager' (7c2d9a60-6b89-4d2f-bb8d-1c98331ada2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:16:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5f6f77c3-9a95-4b84-9413-f1f73cce2401 tempest-TestShelveInstance-140970164 None] Created volume successfully. Sep 28 19:16:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fc228ce2-4718-4ec5-af9f-e495d2d54469 tempest-VolumesTransfersV355Test-1397050924 None] Transfer volume completed successfully. Sep 28 19:16:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Acquiring lock "cinder-f43dd237-9bcd-455f-8e18-e72779c59b17-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:16:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Lock "cinder-f43dd237-9bcd-455f-8e18-e72779c59b17-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:16:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Acquiring lock "cinder-quobyte-f43dd237-9bcd-455f-8e18-e72779c59b17" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:16:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Lock "cinder-quobyte-f43dd237-9bcd-455f-8e18-e72779c59b17" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:16:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a8c8f1-40ac-4ba4-a9ae-45cb92d2440d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:16:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:02 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17 Sep 28 19:16:02 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:02 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17" returned: 0 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:02 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17 Sep 28 19:16:02 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:02 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f43dd237-9bcd-455f-8e18-e72779c59b17" returned: 0 in 0.346s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Lock "cinder-quobyte-f43dd237-9bcd-455f-8e18-e72779c59b17" released by "delete_volume" :: held 0.857s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:16:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Created reservations ['b13c2016-b960-4cb1-9398-5024feaedbc9', '3da6f8d5-2b44-49f1-bdac-097ea1287e6b', 'd52d4a83-0c62-45ce-82b3-25c24f3a6128', 'dde964f8-1368-4db3-8fac-d81f7c68efae'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:03 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:16:03 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:03 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:16:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Deleted volume successfully. Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7f934f2f-0c04-44f6-9603-4e0179a29f92 tempest-VolumesTransfersV355Test-161336203 None] Lock "cinder-f43dd237-9bcd-455f-8e18-e72779c59b17-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Flow 'volume_create_manager' (b1212f1a-2dc0-4714-b2d0-d33f48989e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2141d09c-c6bf-4aca-8859-ef5c40a060ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2141d09c-c6bf-4aca-8859-ef5c40a060ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1631816663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93cbbda-a48e-44c2-ac0e-a5dd39d3b419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8e14dd354d2490f184d501d68f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:16:04Z,use_quota=True,user_id='89e7c013721346f5bfb9b611319e6e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6ed1a5-3dca-4922-ae84-2b683a9461ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6ed1a5-3dca-4922-ae84-2b683a9461ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c477eeed-0c5c-4e96-85d4-561effcd5439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c477eeed-0c5c-4e96-85d4-561effcd5439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f93cbbda-a48e-44c2-ac0e-a5dd39d3b419', 'volume_name': 'volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f719cf3-bdc8-4b69-9176-d299f803363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f719cf3-bdc8-4b69-9176-d299f803363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ad9328-d2f0-49d8-9727-7611768d6424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Volume f93cbbda-a48e-44c2-ac0e-a5dd39d3b419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419', 'volume_size': 1} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1631816663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93cbbda-a48e-44c2-ac0e-a5dd39d3b419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b8e14dd354d2490f184d501d68f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:16:04Z,use_quota=True,user_id='89e7c013721346f5bfb9b611319e6e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Creating volume f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:16:04 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:04 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 1073741824 Sep 28 19:16:04 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 1073741824" returned: 0 in 0.656s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:04 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:04 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 Sep 28 19:16:04 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-fc6ea2a6-0e93-4fd3-8af7-4124366134d0 req-cd99e996-0b53-430e-ae94-5f3ccb827462 tempest-TestShelveInstance-140970164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:16:05 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:16:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:16:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-fc6ea2a6-0e93-4fd3-8af7-4124366134d0 req-cd99e996-0b53-430e-ae94-5f3ccb827462 tempest-TestShelveInstance-140970164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.263s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:16:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ad9328-d2f0-49d8-9727-7611768d6424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711ff5d5-6a67-4c7b-af8a-6005c828d609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-fc6ea2a6-0e93-4fd3-8af7-4124366134d0 req-cd99e996-0b53-430e-ae94-5f3ccb827462 tempest-TestShelveInstance-140970164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:16:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Volume volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 (f93cbbda-a48e-44c2-ac0e-a5dd39d3b419): created successfully Sep 28 19:16:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711ff5d5-6a67-4c7b-af8a-6005c828d609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Flow 'volume_create_manager' (b1212f1a-2dc0-4714-b2d0-d33f48989e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:16:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-fc6ea2a6-0e93-4fd3-8af7-4124366134d0 req-cd99e996-0b53-430e-ae94-5f3ccb827462 tempest-TestShelveInstance-140970164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-2660c029-cce8-4879-9717-28c179f8c24e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18987dbf-378d-4c97-80aa-0512bffb2be9', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:16:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c16bf510-83fa-4b86-961d-bdbacb402904 tempest-VolumesTransfersV355Test-803631021 None] Created volume successfully. Sep 28 19:16:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-fc6ea2a6-0e93-4fd3-8af7-4124366134d0 req-cd99e996-0b53-430e-ae94-5f3ccb827462 tempest-TestShelveInstance-140970164 None] attachment_update completed successfully. Sep 28 19:16:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Acquiring lock "cinder-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:16:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Lock "cinder-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:16:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Acquiring lock "cinder-quobyte-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:16:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Lock "cinder-quobyte-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:16:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c683bcd5-2f13-4d52-a7c2-f7bdeff56e39]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:16:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:06 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 Sep 28 19:16:06 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:06 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:06 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419 Sep 28 19:16:06 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:07 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419" returned: 0 in 0.297s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Lock "cinder-quobyte-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419" released by "delete_volume" :: held 0.803s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Created reservations ['5a877d0a-980c-4563-af68-0afec3aa806f', '2172129b-34b7-4dee-adfc-966a177bc1be', '8f1af7cb-4355-4d99-9a4b-72dc017403d3', '20021b79-41ee-40af-9ec1-9db78fc06b81'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:07 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:16:07 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:07 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.336s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:16:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Deleted volume successfully. Sep 28 19:16:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1bf956f3-f028-41c6-a4f8-562c136d30c6 tempest-VolumesTransfersV355Test-161336203 None] Lock "cinder-f93cbbda-a48e-44c2-ac0e-a5dd39d3b419-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:16:17 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=23,cinder:INSERT=13,cinder:UPDATE=31,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:16:17 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=38,cinder:UPDATE=25,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Flow 'volume_create_manager' (88025a61-7b31-4a06-94cb-c219799f86a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed18794e-58a6-432d-9026-01ec577ef4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed18794e-58a6-432d-9026-01ec577ef4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-535485528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93ab859-0f3c-450f-9039-867c69fcdf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb423e28725441529d3ac453d3b41ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:16:31Z,use_quota=True,user_id='0e7643f40b3c4fb0b56904072188cdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae60b225-2893-4cd9-bef2-8fc3286f1002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae60b225-2893-4cd9-bef2-8fc3286f1002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31028cf-c311-458a-88d6-2309b8b6e036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31028cf-c311-458a-88d6-2309b8b6e036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93ab859-0f3c-450f-9039-867c69fcdf45', 'volume_name': 'volume-c93ab859-0f3c-450f-9039-867c69fcdf45', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e4ad80-09ff-4ba3-8864-6c59a257135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e4ad80-09ff-4ba3-8864-6c59a257135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a50bd5-c356-4e37-bec0-e9eac8a1db44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Volume c93ab859-0f3c-450f-9039-867c69fcdf45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93ab859-0f3c-450f-9039-867c69fcdf45', 'volume_size': 1} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-535485528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93ab859-0f3c-450f-9039-867c69fcdf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb423e28725441529d3ac453d3b41ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:16:31Z,use_quota=True,user_id='0e7643f40b3c4fb0b56904072188cdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Creating volume c93ab859-0f3c-450f-9039-867c69fcdf45 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:16:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:31 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 1073741824 Sep 28 19:16:31 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:31 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 1073741824" returned: 0 in 0.469s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:31 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 Sep 28 19:16:31 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:31 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45" returned: 0 in 0.273s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a50bd5-c356-4e37-bec0-e9eac8a1db44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93ab859-0f3c-450f-9039-867c69fcdf45', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d15f8b8-8fa1-4bfa-883a-7f20f5fd3d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:16:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Volume volume-c93ab859-0f3c-450f-9039-867c69fcdf45 (c93ab859-0f3c-450f-9039-867c69fcdf45): created successfully Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d15f8b8-8fa1-4bfa-883a-7f20f5fd3d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:16:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Flow 'volume_create_manager' (88025a61-7b31-4a06-94cb-c219799f86a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:16:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-497616d1-70b0-4f69-8ef9-7196792beb41 tempest-VolumesActionsTest-455164956 None] Created volume successfully. Sep 28 19:16:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:16:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:16:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:16:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:16:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:16:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:16:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:16:34 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:16:34 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:16:35 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 28 19:16:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.392s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:16:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:16:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:16:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:16:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:16:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9296e98a-dd5c-417f-8dc6-b78e588ef44f tempest-VolumesActionsTest-455164956 None] Acquiring lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45" by "attach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:16:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9296e98a-dd5c-417f-8dc6-b78e588ef44f tempest-VolumesActionsTest-455164956 None] Lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45" acquired by "attach_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:16:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9296e98a-dd5c-417f-8dc6-b78e588ef44f tempest-VolumesActionsTest-455164956 None] Attaching volume c93ab859-0f3c-450f-9039-867c69fcdf45 to instance 7e9c04d3-4f11-48f9-84b1-5aef88f392cc at mountpoint /dev/vdb on host None. Sep 28 19:16:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9296e98a-dd5c-417f-8dc6-b78e588ef44f tempest-VolumesActionsTest-455164956 None] Attach volume completed successfully. Sep 28 19:16:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9296e98a-dd5c-417f-8dc6-b78e588ef44f tempest-VolumesActionsTest-455164956 None] Lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45" released by "attach_volume" :: held 0.136s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:16:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d64885b6-d3f4-4ef6-a051-2923c34c93ed tempest-VolumesActionsTest-455164956 None] Acquiring lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45-detach_volume" by "detach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:16:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d64885b6-d3f4-4ef6-a051-2923c34c93ed tempest-VolumesActionsTest-455164956 None] Lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:16:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d64885b6-d3f4-4ef6-a051-2923c34c93ed tempest-VolumesActionsTest-455164956 None] Detaching volume c93ab859-0f3c-450f-9039-867c69fcdf45 from instance 7e9c04d3-4f11-48f9-84b1-5aef88f392cc. Sep 28 19:16:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d64885b6-d3f4-4ef6-a051-2923c34c93ed tempest-VolumesActionsTest-455164956 None] Detach volume completed successfully. Sep 28 19:16:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d64885b6-d3f4-4ef6-a051-2923c34c93ed tempest-VolumesActionsTest-455164956 None] Lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:16:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-44b76004-da53-44bd-ad72-9dbb22753a65 req-0246ac1d-ce65-4821-8c28-da9fbb066223 tempest-TestShelveInstance-140970164 None] Terminate volume connection completed successfully. Sep 28 19:16:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-44b76004-da53-44bd-ad72-9dbb22753a65 req-0246ac1d-ce65-4821-8c28-da9fbb066223 tempest-TestShelveInstance-140970164 None] Deleting attachment 18987dbf-378d-4c97-80aa-0512bffb2be9. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:16:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-b8a38fe5-ff4d-4e73-a448-a97829a33497 req-71a931d4-3858-4af8-b6d8-43f81740fee1 tempest-TestShelveInstance-140970164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:16:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-b8a38fe5-ff4d-4e73-a448-a97829a33497 req-71a931d4-3858-4af8-b6d8-43f81740fee1 tempest-TestShelveInstance-140970164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:16:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-b8a38fe5-ff4d-4e73-a448-a97829a33497 req-71a931d4-3858-4af8-b6d8-43f81740fee1 tempest-TestShelveInstance-140970164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:16:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-b8a38fe5-ff4d-4e73-a448-a97829a33497 req-71a931d4-3858-4af8-b6d8-43f81740fee1 tempest-TestShelveInstance-140970164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-2660c029-cce8-4879-9717-28c179f8c24e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1d6dbda-00c8-4567-8dee-98ec2e87d6e8', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:16:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-b8a38fe5-ff4d-4e73-a448-a97829a33497 req-71a931d4-3858-4af8-b6d8-43f81740fee1 tempest-TestShelveInstance-140970164 None] attachment_update completed successfully. Sep 28 19:16:55 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=18,cinder:UPDATE=6 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:16:56 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=9,cinder:SELECT=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:16:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7f39a3c4-ebe5-4e82-a2e5-787a61806b0e tempest-VolumesActionsTest-455164956 None] Acquiring lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45" by "attach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:16:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7f39a3c4-ebe5-4e82-a2e5-787a61806b0e tempest-VolumesActionsTest-455164956 None] Lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45" acquired by "attach_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:16:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7f39a3c4-ebe5-4e82-a2e5-787a61806b0e tempest-VolumesActionsTest-455164956 None] Attaching volume c93ab859-0f3c-450f-9039-867c69fcdf45 to instance dd35287d-27fc-4da7-ab83-3772a7c97081 at mountpoint /dev/vdb on host None. Sep 28 19:16:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7f39a3c4-ebe5-4e82-a2e5-787a61806b0e tempest-VolumesActionsTest-455164956 None] Attach volume completed successfully. Sep 28 19:16:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7f39a3c4-ebe5-4e82-a2e5-787a61806b0e tempest-VolumesActionsTest-455164956 None] Lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45" released by "attach_volume" :: held 0.122s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:16:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-566ef2e7-8c14-4e4e-8f44-05aaa498b523 tempest-VolumesActionsTest-455164956 None] Acquiring lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45-detach_volume" by "detach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:16:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-566ef2e7-8c14-4e4e-8f44-05aaa498b523 tempest-VolumesActionsTest-455164956 None] Lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:16:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-566ef2e7-8c14-4e4e-8f44-05aaa498b523 tempest-VolumesActionsTest-455164956 None] Detaching volume c93ab859-0f3c-450f-9039-867c69fcdf45 from instance dd35287d-27fc-4da7-ab83-3772a7c97081. Sep 28 19:16:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-566ef2e7-8c14-4e4e-8f44-05aaa498b523 tempest-VolumesActionsTest-455164956 None] Detach volume completed successfully. Sep 28 19:16:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-566ef2e7-8c14-4e4e-8f44-05aaa498b523 tempest-VolumesActionsTest-455164956 None] Lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:17:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5578c9fd-4ffb-4570-9fe3-3cb32e9cde41]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:01 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 Sep 28 19:17:01 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:02 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45" returned: 0 in 0.420s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea379de9-641c-40db-9228-9fbeffcd8959]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:02 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 Sep 28 19:17:02 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:02 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.48a647a7-9ecf-4136-b1b9-469ce7f2143ao2zg4jew.img {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:02 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.48a647a7-9ecf-4136-b1b9-469ce7f2143ao2zg4jew.img Sep 28 19:17:02 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:06 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:INSERT=1,cinder:SELECT=3,cinder:UPDATE=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:17:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.48a647a7-9ecf-4136-b1b9-469ce7f2143ao2zg4jew.img" returned: 0 in 7.697s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9abd3-9df0-4418-9f25-d681070156c6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:10 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 Sep 28 19:17:10 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:11 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45" returned: 0 in 0.762s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:11 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45, size 1024.00 MB, duration 7.70 sec, destination /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.48a647a7-9ecf-4136-b1b9-469ce7f2143ao2zg4jew.img {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:17:11 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Converted 1024.00 MB image at 133.01 MB/s Sep 28 19:17:11 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] 48a647a7-9ecf-4136-b1b9-469ce7f2143a was raw, no need to convert to raw {{(pid=86846) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 19:17:21 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=14,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:17:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.814s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Uploaded volume to glance image-id: 48a647a7-9ecf-4136-b1b9-469ce7f2143a. {{(pid=86846) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 19:17:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c8e88145-bb4b-45b8-ab4d-59750d44dbc8 tempest-VolumesActionsTest-455164956 None] Copy volume to image completed successfully. Sep 28 19:17:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[903a726d-5a94-4640-960a-b50a5d1935a5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:32 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 Sep 28 19:17:32 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:32 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45" returned: 0 in 0.462s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f089624-5152-42b5-9105-754e8696045d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:32 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 Sep 28 19:17:32 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:33 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45" returned: 0 in 0.554s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:33 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img Sep 28 19:17:33 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-1c553c6c-b799-4bbb-abf4-31da66c20f81 tempest-TestShelveInstance-140970164 None] Terminate volume connection completed successfully. Sep 28 19:17:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-1c553c6c-b799-4bbb-abf4-31da66c20f81 tempest-TestShelveInstance-140970164 None] Deleting attachment d1d6dbda-00c8-4567-8dee-98ec2e87d6e8. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:17:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:17:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:17:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:17:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:34 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:17:34 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Acquiring lock "cinder-2660c029-cce8-4879-9717-28c179f8c24e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Lock "cinder-2660c029-cce8-4879-9717-28c179f8c24e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Acquiring lock "cinder-quobyte-2660c029-cce8-4879-9717-28c179f8c24e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Lock "cinder-quobyte-2660c029-cce8-4879-9717-28c179f8c24e" acquired by "delete_volume" :: waited 0.050s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:17:35 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.613s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ca24af-5421-493c-9ad2-3c63e5504182]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:17:35 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e Sep 28 19:17:35 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:35 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e" returned: 0 in 0.653s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:35 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e Sep 28 19:17:35 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:36 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2660c029-cce8-4879-9717-28c179f8c24e" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Lock "cinder-quobyte-2660c029-cce8-4879-9717-28c179f8c24e" released by "delete_volume" :: held 1.133s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG cinder.quota [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Created reservations ['2c7f697f-f3e9-46ad-9368-2e89797e7321', 'f17b57f6-d0fb-4d85-98e8-8de7fb6ce045', '63bbb076-839c-4d59-85f5-5676f98e5726', 'af2869a6-2cee-4163-8cbe-04df5ec3adf2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:36 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:17:36 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:36 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.367s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:36 devstack cinder-volume[86846]: DEBUG cinder.manager [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:17:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Deleted volume successfully. Sep 28 19:17:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-19cd6d83-2f16-4623-9ce2-e4b0ad27c075 req-fbb77ffc-a8c8-4f30-a94e-e3e9da9dbf1e tempest-TestShelveInstance-140970164 None] Lock "cinder-2660c029-cce8-4879-9717-28c179f8c24e-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:17:41 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img" returned: 0 in 7.943s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:41 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da6d8a-496e-48f5-b141-2e94dd92a8f7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:41 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 Sep 28 19:17:41 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:41 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45" returned: 0 in 0.588s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:41 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45, size 1024.00 MB, duration 7.94 sec, destination /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:17:41 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Converted 1024.00 MB image at 128.91 MB/s Sep 28 19:17:41 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] 9115f8be-411d-4855-b515-ee746a235083 was raw, converting to qcow2 {{(pid=86846) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 19:17:41 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8aa3c9-ce86-474e-b6b0-2c278436345d]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:41 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img Sep 28 19:17:41 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:42 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:42 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img Sep 28 19:17:42 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:42 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img" returned: 1 in 0.387s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:17:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img /opt/stack/data/cinder/conversion/vol_upload_z00k_gvf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:42 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img /opt/stack/data/cinder/conversion/vol_upload_z00k_gvf Sep 28 19:17:42 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:42 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img /opt/stack/data/cinder/conversion/vol_upload_z00k_gvf" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:42 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Image conversion details: src /opt/stack/data/cinder/conversion/c93ab859-0f3c-450f-9039-867c69fcdf45.temp_image.9115f8be-411d-4855-b515-ee746a2350831ru2_27u.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_z00k_gvf {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:17:42 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 19:17:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91edd6-dc30-4ac3-b15d-f9f725e6efea]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z00k_gvf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:43 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z00k_gvf Sep 28 19:17:43 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:43 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z00k_gvf" returned: 0 in 0.426s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.883s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Uploaded volume to glance image-id: 9115f8be-411d-4855-b515-ee746a235083. {{(pid=86846) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 19:17:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b948449f-e177-4281-8913-e5bd9e570436 tempest-VolumesActionsTest-455164956 None] Copy volume to image completed successfully. Sep 28 19:17:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Acquiring lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:17:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:17:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Acquiring lock "cinder-quobyte-c93ab859-0f3c-450f-9039-867c69fcdf45" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:17:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Lock "cinder-quobyte-c93ab859-0f3c-450f-9039-867c69fcdf45" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:17:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed91ea0-f9fd-4ab4-9778-9ea583fc9180]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:46 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 Sep 28 19:17:46 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:47 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45" returned: 0 in 0.392s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:47 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45 Sep 28 19:17:47 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:47 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93ab859-0f3c-450f-9039-867c69fcdf45" returned: 0 in 0.282s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Lock "cinder-quobyte-c93ab859-0f3c-450f-9039-867c69fcdf45" released by "delete_volume" :: held 0.722s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Created reservations ['cfccec00-d352-4f0c-a4ee-05f424f7e71c', 'ec08b472-aada-4ddf-8a53-2d43ce874f0a', '40a7967d-9c9a-442b-b4ed-77427feeeb14', 'd72d1252-1a97-454c-bd88-cef15c5999b4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:47 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:17:47 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:48 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.356s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:48 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:17:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Deleted volume successfully. Sep 28 19:17:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4d2d1-8b88-48d0-add1-cbfe4d0519c6 tempest-VolumesActionsTest-455164956 None] Lock "cinder-c93ab859-0f3c-450f-9039-867c69fcdf45-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (40cc3a4d-5390-4223-bf36-20a33bc1105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7a9fd1-8230-49e3-a61f-ff3eccce23f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7a9fd1-8230-49e3-a61f-ff3eccce23f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1911703928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:53Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702fc47d-e3c0-4a52-8b22-6c8a465d8232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702fc47d-e3c0-4a52-8b22-6c8a465d8232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb7d411-090d-4e97-9247-8a8bd7278f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb7d411-090d-4e97-9247-8a8bd7278f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e37c7d-1f9e-4f3d-8f0b-975cd4d32618', 'volume_name': 'volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b7f79b-7f4c-4d6f-a1a1-ee95d6a7f3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b7f79b-7f4c-4d6f-a1a1-ee95d6a7f3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95abfd5-d628-4026-8f71-5c5325e8314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:52 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618', 'volume_size': 1} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1911703928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:53Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Creating volume d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:17:52 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:17:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:52 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 1073741824 Sep 28 19:17:52 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:53 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 1073741824" returned: 0 in 0.520s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:53 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 Sep 28 19:17:53 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:53 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618" returned: 0 in 0.307s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:17:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95abfd5-d628-4026-8f71-5c5325e8314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420171db-34f5-4d0a-8e1c-da8aa76331b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:53 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 (d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618): created successfully Sep 28 19:17:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420171db-34f5-4d0a-8e1c-da8aa76331b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (40cc3a4d-5390-4223-bf36-20a33bc1105a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e4ac0c32-7587-4ce3-b426-cc78f39bf64c tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created volume successfully. Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (b16a2d9a-1570-4f5b-8ba5-23df74f4ce55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11fbfa5-92ce-4e14-b0ed-a26fa61f358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11fbfa5-92ce-4e14-b0ed-a26fa61f358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1509108928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dbdef8-309e-4737-9921-5e52edfd08e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:55Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af5a571-1379-450f-87b4-eeae624d2318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af5a571-1379-450f-87b4-eeae624d2318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402ca2c7-f06e-475a-9f84-f08ecdddea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402ca2c7-f06e-475a-9f84-f08ecdddea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17dbdef8-309e-4737-9921-5e52edfd08e9', 'volume_name': 'volume-17dbdef8-309e-4737-9921-5e52edfd08e9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8434d8f7-30e5-4e92-82de-c7b7fa4e0402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8434d8f7-30e5-4e92-82de-c7b7fa4e0402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06748420-ace6-438e-a6b4-ad68d5cb8dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:55 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume 17dbdef8-309e-4737-9921-5e52edfd08e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17dbdef8-309e-4737-9921-5e52edfd08e9', 'volume_size': 1} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1509108928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dbdef8-309e-4737-9921-5e52edfd08e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:55Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Creating volume 17dbdef8-309e-4737-9921-5e52edfd08e9 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:17:55 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:55 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9 1073741824 Sep 28 19:17:55 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (fc9e1cf0-b91c-4b15-a735-e70d1eba42a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3546909e-36c0-4466-8cbb-130e82090053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3546909e-36c0-4466-8cbb-130e82090053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-123805342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ce387c-370e-41b9-a620-bd7fae5711a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:56Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5191f89-5670-4b56-b968-7afe1c9429b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5191f89-5670-4b56-b968-7afe1c9429b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb09224-9984-4701-8fda-19f36ff8e231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb09224-9984-4701-8fda-19f36ff8e231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ce387c-370e-41b9-a620-bd7fae5711a1', 'volume_name': 'volume-50ce387c-370e-41b9-a620-bd7fae5711a1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b623b8-7814-4161-8d93-f3173e1f208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b623b8-7814-4161-8d93-f3173e1f208a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2ed982-5955-479c-9455-67f1e2605e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:55 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume 50ce387c-370e-41b9-a620-bd7fae5711a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ce387c-370e-41b9-a620-bd7fae5711a1', 'volume_size': 1} Sep 28 19:17:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:56 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9 1073741824" returned: 0 in 0.631s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:56 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9 Sep 28 19:17:56 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (459f4fce-878d-4b58-9a94-64db040e579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7964a3d-0a56-46b9-8a76-2c0d3e787710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7964a3d-0a56-46b9-8a76-2c0d3e787710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1510935945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84130b3e-08a1-4178-8a0a-3320728fc437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:56Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97f1905-c6e3-474a-9429-6270d31b5fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97f1905-c6e3-474a-9429-6270d31b5fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241f7912-8c19-43d9-8943-d759c307e5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241f7912-8c19-43d9-8943-d759c307e5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84130b3e-08a1-4178-8a0a-3320728fc437', 'volume_name': 'volume-84130b3e-08a1-4178-8a0a-3320728fc437', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e0fb89-b165-443c-abe6-5db691a66d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e0fb89-b165-443c-abe6-5db691a66d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b092ec-3613-4337-ab62-25c59adf200a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume 84130b3e-08a1-4178-8a0a-3320728fc437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84130b3e-08a1-4178-8a0a-3320728fc437', 'volume_size': 1} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:56 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-123805342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ce387c-370e-41b9-a620-bd7fae5711a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:56Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Creating volume 50ce387c-370e-41b9-a620-bd7fae5711a1 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:17:56 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06748420-ace6-438e-a6b4-ad68d5cb8dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17dbdef8-309e-4737-9921-5e52edfd08e9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342d83a6-2fb3-426a-9eaf-9baf3f80596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1 1073741824 Sep 28 19:17:56 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume volume-17dbdef8-309e-4737-9921-5e52edfd08e9 (17dbdef8-309e-4737-9921-5e52edfd08e9): created successfully Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342d83a6-2fb3-426a-9eaf-9baf3f80596e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (b16a2d9a-1570-4f5b-8ba5-23df74f4ce55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-41ab7c02-674e-4c6e-8002-522888c9f15d tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created volume successfully. Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (89142674-dc97-4f54-b9b5-e22ee95c3050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311e5fa5-0dbc-4fcc-9cdd-fcd861455b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311e5fa5-0dbc-4fcc-9cdd-fcd861455b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1438041075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0aaa29-472f-4267-b498-cb9c7185f327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:57Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ff4d34-1d25-4c9a-be3f-d2a5887a9be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ff4d34-1d25-4c9a-be3f-d2a5887a9be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace5ba2a-6c48-4070-a368-742d1b5f7737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace5ba2a-6c48-4070-a368-742d1b5f7737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f0aaa29-472f-4267-b498-cb9c7185f327', 'volume_name': 'volume-9f0aaa29-472f-4267-b498-cb9c7185f327', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639d7c24-a761-4ada-822e-b56fed7574e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639d7c24-a761-4ada-822e-b56fed7574e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837cc575-9b66-4584-b076-28596d060ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume 9f0aaa29-472f-4267-b498-cb9c7185f327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f0aaa29-472f-4267-b498-cb9c7185f327', 'volume_size': 1} Sep 28 19:17:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:57 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1 1073741824" returned: 0 in 0.630s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:57 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1 Sep 28 19:17:57 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (0f444cbc-9a6a-4a50-af46-7ff2accc2ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b29a00-09cf-41a9-96a9-4b038eea40f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b29a00-09cf-41a9-96a9-4b038eea40f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-143766087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f1fe63-43bf-4843-ab22-8fde532e3856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:57Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b929c817-518e-48e6-8fe1-07f17fb47738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b929c817-518e-48e6-8fe1-07f17fb47738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c67556b-9d41-4a2a-bd89-927049cbd9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c67556b-9d41-4a2a-bd89-927049cbd9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f1fe63-43bf-4843-ab22-8fde532e3856', 'volume_name': 'volume-b8f1fe63-43bf-4843-ab22-8fde532e3856', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72f6dda-9087-408a-9abc-f65d98a6d6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72f6dda-9087-408a-9abc-f65d98a6d6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6cd40f-21f8-4ad1-93e5-3884ebacf88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume b8f1fe63-43bf-4843-ab22-8fde532e3856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f1fe63-43bf-4843-ab22-8fde532e3856', 'volume_size': 1} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Flow 'volume_create_manager' (1c07e381-7b7d-423a-84de-9d5f9db5a536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dee8396-c4d6-40fa-9768-b7dbbb3a6e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dee8396-c4d6-40fa-9768-b7dbbb3a6e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-981933531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4d2030-12b6-47ab-bd3e-029feaab749c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9618e6a174644edb85e1507e645fd71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:57Z,use_quota=True,user_id='632f5c41d14341c4aee700c64d62e62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f540fd41-8cfa-4d91-bb71-a29586ca09ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f540fd41-8cfa-4d91-bb71-a29586ca09ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:57 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f23d28-cdc4-4dd3-be59-95c9a9d8d652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1" returned: 0 in 0.297s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1510935945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84130b3e-08a1-4178-8a0a-3320728fc437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:56Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Creating volume 84130b3e-08a1-4178-8a0a-3320728fc437 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:17:57 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2ed982-5955-479c-9455-67f1e2605e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ce387c-370e-41b9-a620-bd7fae5711a1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:57 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437 1073741824 Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2787316-abc1-450e-bbd3-8373e4e5ff74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:57 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume volume-50ce387c-370e-41b9-a620-bd7fae5711a1 (50ce387c-370e-41b9-a620-bd7fae5711a1): created successfully Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2787316-abc1-450e-bbd3-8373e4e5ff74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (fc9e1cf0-b91c-4b15-a735-e70d1eba42a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a42fd310-3ac4-4309-aff5-ab35d65d46b1 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created volume successfully. Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f23d28-cdc4-4dd3-be59-95c9a9d8d652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e4d2030-12b6-47ab-bd3e-029feaab749c', 'volume_name': 'volume-4e4d2030-12b6-47ab-bd3e-029feaab749c', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e017a1-6248-459b-9662-5fda8510645f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e017a1-6248-459b-9662-5fda8510645f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f04c0c3-6cba-412b-b67d-b860d303ddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:57 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Volume 4e4d2030-12b6-47ab-bd3e-029feaab749c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e4d2030-12b6-47ab-bd3e-029feaab749c', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 19:17:57 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Trying to clone 4e4d2030-12b6-47ab-bd3e-029feaab749c from image 62ee51ad-b6ed-458d-a726-fccffd745d46 at location (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 19:17:58 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437 1073741824" returned: 0 in 0.519s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 19:17:58 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Image download 20.69 MB at 20.69 MB/s Sep 28 19:17:58 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437 Sep 28 19:17:58 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11320cf-f566-4b17-b7cb-beb318e30626]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:58 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD Sep 28 19:17:58 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:58 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437" returned: 0 in 0.266s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1438041075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0aaa29-472f-4267-b498-cb9c7185f327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:57Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Creating volume 9f0aaa29-472f-4267-b498-cb9c7185f327 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:17:58 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:58 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327 1073741824 Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b092ec-3613-4337-ab62-25c59adf200a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84130b3e-08a1-4178-8a0a-3320728fc437', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:58 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377a79d2-72e1-47ee-a1ae-2b33bf3bbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume volume-84130b3e-08a1-4178-8a0a-3320728fc437 (84130b3e-08a1-4178-8a0a-3320728fc437): created successfully Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377a79d2-72e1-47ee-a1ae-2b33bf3bbe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (459f4fce-878d-4b58-9a94-64db040e579d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ceb973eb-a439-4c4f-966b-2e6fadadb50e tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created volume successfully. Sep 28 19:17:58 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Temporary image 62ee51ad-b6ed-458d-a726-fccffd745d46 is fetched for user 632f5c41d14341c4aee700c64d62e62b. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[981cbf14-1d55-464b-b718-b647058d6994]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:58 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD Sep 28 19:17:58 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:58 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327 1073741824" returned: 0 in 0.442s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:58 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327 Sep 28 19:17:58 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:59 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:59 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327" returned: 0 in 0.250s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.719s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-143766087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f1fe63-43bf-4843-ab22-8fde532e3856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a019c3ee1f848c1a6e738cafcb79383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:57Z,use_quota=True,user_id='a1c2c295308b4e24bfae0fbd1b77f758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Creating volume b8f1fe63-43bf-4843-ab22-8fde532e3856 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:17:59 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837cc575-9b66-4584-b076-28596d060ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f0aaa29-472f-4267-b498-cb9c7185f327', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76dd1ed-1cb9-4e74-ab61-6574ea3e86a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:59 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856 1073741824 Sep 28 19:17:59 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:59 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume volume-9f0aaa29-472f-4267-b498-cb9c7185f327 (9f0aaa29-472f-4267-b498-cb9c7185f327): created successfully Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76dd1ed-1cb9-4e74-ab61-6574ea3e86a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (89142674-dc97-4f54-b9b5-e22ee95c3050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:17:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fc431434-97d5-48a0-95f3-f0abfccc87c6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created volume successfully. Sep 28 19:17:59 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856 1073741824" returned: 0 in 0.444s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:59 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856 Sep 28 19:17:59 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:17:59 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856" returned: 0 in 0.249s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-981933531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4d2030-12b6-47ab-bd3e-029feaab749c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9618e6a174644edb85e1507e645fd71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:17:57Z,use_quota=True,user_id='632f5c41d14341c4aee700c64d62e62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Creating volume 4e4d2030-12b6-47ab-bd3e-029feaab749c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:17:59 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6cd40f-21f8-4ad1-93e5-3884ebacf88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f1fe63-43bf-4843-ab22-8fde532e3856', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:17:59 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c 1073741824 Sep 28 19:17:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ea5b30-bbec-40bf-8e28-72367502fbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:17:59 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Volume volume-b8f1fe63-43bf-4843-ab22-8fde532e3856 (b8f1fe63-43bf-4843-ab22-8fde532e3856): created successfully Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ea5b30-bbec-40bf-8e28-72367502fbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Flow 'volume_create_manager' (0f444cbc-9a6a-4a50-af46-7ff2accc2ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6e07f298-d364-4274-bf44-d91c4419610b tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created volume successfully. Sep 28 19:18:00 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c 1073741824" returned: 0 in 0.448s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:00 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c Sep 28 19:18:00 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-b8f1fe63-43bf-4843-ab22-8fde532e3856-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-b8f1fe63-43bf-4843-ab22-8fde532e3856-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-quobyte-b8f1fe63-43bf-4843-ab22-8fde532e3856" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-b8f1fe63-43bf-4843-ab22-8fde532e3856" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:00 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c" returned: 0 in 0.289s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3537c8d5-d194-471b-83e0-6200e99e7afb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Attempting download of 62ee51ad-b6ed-458d-a726-fccffd745d46 ((None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}])) to volume 4e4d2030-12b6-47ab-bd3e-029feaab749c. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00001e3-10d9-4705-8b59-e726416baf2d]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_78s2awqu {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:00 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856 Sep 28 19:18:00 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:00 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_78s2awqu Sep 28 19:18:00 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:01 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856" returned: 0 in 0.388s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:01 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856 Sep 28 19:18:01 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:01 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_78s2awqu" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_78s2awqu {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:01 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_78s2awqu Sep 28 19:18:01 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:01 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b8f1fe63-43bf-4843-ab22-8fde532e3856" returned: 0 in 0.262s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-b8f1fe63-43bf-4843-ab22-8fde532e3856" released by "delete_volume" :: held 0.704s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created reservations ['4122cdbd-87cd-4c61-b214-fa8d4a33330b', '3972bae3-b298-4087-9b07-98aa92f66482', '01b5cdbd-1e14-4926-9e14-cd2283f1334d', '7b1a93a1-2d0e-44ec-a72c-e101a09feeb0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:01 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_78s2awqu" returned: 1 in 0.386s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62ee51ad-b6ed-458d-a726-fccffd745d46_78s2awqu' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7ea2dd-2f73-4087-b368-cf9a846ea392]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:01 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:01 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:01 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD Sep 28 19:18:01 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-9f0aaa29-472f-4267-b498-cb9c7185f327-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:01 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.302s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-9f0aaa29-472f-4267-b498-cb9c7185f327-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Deleted volume successfully. Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ffe56fb1-dd14-46bb-af7e-d1714258577f tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-b8f1fe63-43bf-4843-ab22-8fde532e3856-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-quobyte-9f0aaa29-472f-4267-b498-cb9c7185f327" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-9f0aaa29-472f-4267-b498-cb9c7185f327" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ac213f-2168-4268-96a2-af00d4c613f2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:01 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] 62ee51ad-b6ed-458d-a726-fccffd745d46 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:02 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c Sep 28 19:18:02 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:02 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327 Sep 28 19:18:02 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:02 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327" returned: 0 in 0.418s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:02 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327 Sep 28 19:18:02 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:02 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f0aaa29-472f-4267-b498-cb9c7185f327" returned: 0 in 0.282s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-9f0aaa29-472f-4267-b498-cb9c7185f327" released by "delete_volume" :: held 0.746s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created reservations ['c3c796b5-8a30-4a8c-b4e7-e79f8289b216', 'cfabad9e-c4e2-4ee3-89f3-914fae51bebf', '1c53692b-7ca7-4252-97d9-4dff7895bbb2', 'b1bf948c-1eef-4279-951c-7c4786dba162'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:02 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:02 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-84130b3e-08a1-4178-8a0a-3320728fc437-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-84130b3e-08a1-4178-8a0a-3320728fc437-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-quobyte-84130b3e-08a1-4178-8a0a-3320728fc437" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-84130b3e-08a1-4178-8a0a-3320728fc437" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6edeea2-0d96-41e8-a2a3-452ea614bf59]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:03 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.324s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Deleted volume successfully. Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6b40b02e-2f6a-4f20-82d7-d9392ab984a6 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-9f0aaa29-472f-4267-b498-cb9c7185f327-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:03 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437 Sep 28 19:18:03 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:03 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437" returned: 0 in 0.488s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:03 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437 Sep 28 19:18:03 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:03 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84130b3e-08a1-4178-8a0a-3320728fc437" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-84130b3e-08a1-4178-8a0a-3320728fc437" released by "delete_volume" :: held 0.817s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created reservations ['6fd0209f-7213-4526-9d9b-234f0c03ca56', '2f38041c-2156-4e24-8d01-a645bd5898c4', '3fea300d-6213-4cc9-a040-7dcd7d0124ba', 'baf26f41-9c5b-4b1d-a173-557e4a255c30'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:04 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c" returned: 0 in 2.117s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_62ee51ad-b6ed-458d-a726-fccffd745d46_pwvqsy_idevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:18:04 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Converted 112.00 MB image at 52.84 MB/s Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:04 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:04 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:04 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c 1G Sep 28 19:18:04 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-50ce387c-370e-41b9-a620-bd7fae5711a1-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-50ce387c-370e-41b9-a620-bd7fae5711a1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-quobyte-50ce387c-370e-41b9-a620-bd7fae5711a1" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-50ce387c-370e-41b9-a620-bd7fae5711a1" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefc1930-2380-4238-9dba-b96fdef4fbe6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:04 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.278s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Deleted volume successfully. Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8810c2a5-5d91-4ca9-babf-89db415fba97 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-84130b3e-08a1-4178-8a0a-3320728fc437-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:04 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1 Sep 28 19:18:04 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:04 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c 1G" returned: 0 in 0.407s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Downloaded image 62ee51ad-b6ed-458d-a726-fccffd745d46 ((None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}])) to volume 4e4d2030-12b6-47ab-bd3e-029feaab749c successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Temporary image 62ee51ad-b6ed-458d-a726-fccffd745d46 for user 632f5c41d14341c4aee700c64d62e62b is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Marking volume 4e4d2030-12b6-47ab-bd3e-029feaab749c as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Copying metadata from image 62ee51ad-b6ed-458d-a726-fccffd745d46 to 4e4d2030-12b6-47ab-bd3e-029feaab749c. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Creating volume glance metadata for volume 4e4d2030-12b6-47ab-bd3e-029feaab749c backed by image 62ee51ad-b6ed-458d-a726-fccffd745d46 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f04c0c3-6cba-412b-b67d-b860d303ddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4d2030-12b6-47ab-bd3e-029feaab749c', 'volume_size': 1, 'image_id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62ee51ad-b6ed-458d-a726-fccffd745d46', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '58ab5e543e3444bea0585571f42108cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62ee51ad-b6ed-458d-a726-fccffd745d46', 'created_at': datetime.datetime(2026, 9, 28, 16, 54, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 54, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62ee51ad-b6ed-458d-a726-fccffd745d46/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67519316-004c-4859-8336-7bcc0b7f079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Volume volume-4e4d2030-12b6-47ab-bd3e-029feaab749c (4e4d2030-12b6-47ab-bd3e-029feaab749c): created successfully Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67519316-004c-4859-8336-7bcc0b7f079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Flow 'volume_create_manager' (1c07e381-7b7d-423a-84de-9d5f9db5a536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-601ff427-c551-45a2-b746-59baa38ab194 tempest-VolumesExtendTest-1463210403 None] Created volume successfully. Sep 28 19:18:04 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1" returned: 0 in 0.392s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:04 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1 Sep 28 19:18:04 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:05 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-50ce387c-370e-41b9-a620-bd7fae5711a1" returned: 0 in 0.243s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-50ce387c-370e-41b9-a620-bd7fae5711a1" released by "delete_volume" :: held 0.689s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created reservations ['d7867537-36f3-4c44-99fe-6d4f1959d21b', '119581d0-3882-4b63-97e5-34fe0da54f91', '5f9a5356-3022-4be9-8cdd-6d8f09bb15d9', '21f57b73-1c02-4657-b594-ea80b9fddb4b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:05 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:05 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:05 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.266s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Deleted volume successfully. Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-17dbdef8-309e-4737-9921-5e52edfd08e9-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f4c96f82-b75e-4d1f-ae15-6b4ec4fc3cd0 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-50ce387c-370e-41b9-a620-bd7fae5711a1-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-17dbdef8-309e-4737-9921-5e52edfd08e9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-quobyte-17dbdef8-309e-4737-9921-5e52edfd08e9" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-17dbdef8-309e-4737-9921-5e52edfd08e9" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c29ef2-b06e-43e9-b823-c8c4f38b3494]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:05 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9 Sep 28 19:18:05 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bacf4c2f-0f8c-497a-afad-c77663584313 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bacf4c2f-0f8c-497a-afad-c77663584313 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:05 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9" returned: 0 in 0.417s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcfe39a-2918-49d7-b4a0-58b1b886ec05]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bacf4c2f-0f8c-497a-afad-c77663584313 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:06 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9 Sep 28 19:18:06 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:06 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c Sep 28 19:18:06 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:06 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-17dbdef8-309e-4737-9921-5e52edfd08e9" returned: 0 in 0.257s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-17dbdef8-309e-4737-9921-5e52edfd08e9" released by "delete_volume" :: held 0.726s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created reservations ['7553d252-8772-459d-a0e9-b49cd6c3c06f', '735a49be-d5b4-442d-90e4-69a42a8f5a0e', '8fc149f2-5b03-4d90-bf03-f60c366bfe36', '06977dff-ae24-4569-9d6e-c084f504a38e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:06 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bacf4c2f-0f8c-497a-afad-c77663584313 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c" returned: 0 in 0.391s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bacf4c2f-0f8c-497a-afad-c77663584313 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c 2G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:06 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:06 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bacf4c2f-0f8c-497a-afad-c77663584313 tempest-VolumesExtendTest-1463210403 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c 2G" returned: 0 in 0.111s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bacf4c2f-0f8c-497a-afad-c77663584313 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.536s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bacf4c2f-0f8c-497a-afad-c77663584313 tempest-VolumesExtendTest-1463210403 None] Extend volume completed successfully. Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "cinder-quobyte-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:06 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Deleted volume successfully. Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c91c09-c77c-4949-9eba-d602552a77b3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-27f09809-147c-467e-a146-63f38fe8b403 tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-17dbdef8-309e-4737-9921-5e52edfd08e9-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:06 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 Sep 28 19:18:06 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:07 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618" returned: 0 in 0.397s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:07 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618 Sep 28 19:18:07 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "cinder-4e4d2030-12b6-47ab-bd3e-029feaab749c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-4e4d2030-12b6-47ab-bd3e-029feaab749c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "cinder-quobyte-4e4d2030-12b6-47ab-bd3e-029feaab749c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-quobyte-4e4d2030-12b6-47ab-bd3e-029feaab749c" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c8fa66-e6da-48d1-8e37-c33d4e721826]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:07 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-quobyte-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618" released by "delete_volume" :: held 0.751s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:07 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Created reservations ['10d6b48f-258f-472a-bdbb-22e9dc05a17c', '639c9360-5cc5-454a-a6ae-f6918d1df95d', '368cd31f-5dd3-4559-9d69-b42e838b82a0', '704c8712-0c7f-4a34-8494-0705067b432e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:07 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:07 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:07 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:07 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c" returned: 0 in 0.423s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:07 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c Sep 28 19:18:07 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:07 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Deleted volume successfully. Sep 28 19:18:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2638e2a4-e553-4e4f-b13b-a24de9ade9ff tempest-CreateVolumesFromSourceVolumeTest-1915431179 None] Lock "cinder-d0e37c7d-1f9e-4f3d-8f0b-975cd4d32618-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:08 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4e4d2030-12b6-47ab-bd3e-029feaab749c" returned: 0 in 0.289s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-quobyte-4e4d2030-12b6-47ab-bd3e-029feaab749c" released by "delete_volume" :: held 0.755s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Created reservations ['f93bfcfe-4331-4444-890f-815787314a2f', '95975d55-1ce5-460e-86c5-625e5ae6b515', 'f9131545-618e-451f-bb7d-a43ef19241f8', 'cd842f45-59d5-4578-a739-53e25128a079'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:08 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:08 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:08 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Deleted volume successfully. Sep 28 19:18:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f7c3726-2d9d-40fd-b831-579e3d61d713 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-4e4d2030-12b6-47ab-bd3e-029feaab749c-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Flow 'volume_create_manager' (1786ce8d-6f35-496f-b8d0-f6f548b995d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b79c2c0-c0df-4619-879f-e1fd0b08a620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b79c2c0-c0df-4619-879f-e1fd0b08a620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1543703799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6ab6a3-60c5-4fb6-af25-b131a6505ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9618e6a174644edb85e1507e645fd71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:09Z,use_quota=True,user_id='632f5c41d14341c4aee700c64d62e62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2458ac4-50e2-428e-8af6-22234eeaabb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2458ac4-50e2-428e-8af6-22234eeaabb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c713a30e-1421-428e-baf3-b16e7d247ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c713a30e-1421-428e-baf3-b16e7d247ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a6ab6a3-60c5-4fb6-af25-b131a6505ff7', 'volume_name': 'volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e077c218-0e10-4786-a2ab-aaa88c122a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e077c218-0e10-4786-a2ab-aaa88c122a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f778f7-6bf3-4777-a0d6-840b77a71fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Volume 1a6ab6a3-60c5-4fb6-af25-b131a6505ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7', 'volume_size': 1} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1543703799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6ab6a3-60c5-4fb6-af25-b131a6505ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9618e6a174644edb85e1507e645fd71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:09Z,use_quota=True,user_id='632f5c41d14341c4aee700c64d62e62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Creating volume 1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:18:09 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:09 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 1073741824 Sep 28 19:18:09 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:09 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 1073741824" returned: 0 in 0.523s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:09 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 Sep 28 19:18:09 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:10 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" returned: 0 in 0.338s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:18:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f778f7-6bf3-4777-a0d6-840b77a71fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa8929f-1347-440e-bbc0-35614e5dd925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Volume volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 (1a6ab6a3-60c5-4fb6-af25-b131a6505ff7): created successfully Sep 28 19:18:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa8929f-1347-440e-bbc0-35614e5dd925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Flow 'volume_create_manager' (1786ce8d-6f35-496f-b8d0-f6f548b995d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0bb97a02-2eab-480c-99bc-86109ecac00c tempest-VolumesExtendTest-1463210403 None] Created volume successfully. Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Flow 'volume_create_manager' (571e30f2-430d-4335-9741-759e4e6bf06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8a7cdf-64dc-4071-976b-ccbfad7299ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8a7cdf-64dc-4071-976b-ccbfad7299ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-372029526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39589d76-32bf-4a43-b2a3-c9e6ae26be97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0040eb568cf94b73b85dc60295efc59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:11Z,use_quota=True,user_id='bdfd009d191d4bb7911c551ab18c1b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffec970-3ed8-4ba6-b05f-c0680d156744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffec970-3ed8-4ba6-b05f-c0680d156744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce67b6d1-6f4b-44eb-aa2f-6f06c0a74ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce67b6d1-6f4b-44eb-aa2f-6f06c0a74ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39589d76-32bf-4a43-b2a3-c9e6ae26be97', 'volume_name': 'volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736a7612-5ef4-43fd-83de-d3e93f373209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736a7612-5ef4-43fd-83de-d3e93f373209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f9e809-7dd7-41a9-bc9b-5b12b12f8f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Volume 39589d76-32bf-4a43-b2a3-c9e6ae26be97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97', 'volume_size': 1} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-372029526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39589d76-32bf-4a43-b2a3-c9e6ae26be97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0040eb568cf94b73b85dc60295efc59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:11Z,use_quota=True,user_id='bdfd009d191d4bb7911c551ab18c1b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Creating volume 39589d76-32bf-4a43-b2a3-c9e6ae26be97 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:18:11 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:11 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 1073741824 Sep 28 19:18:11 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:11 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 1073741824" returned: 0 in 0.496s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:12 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 Sep 28 19:18:12 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:12 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.826s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f9e809-7dd7-41a9-bc9b-5b12b12f8f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f096e95-5a41-4fb4-9f2a-7c2178f98f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Creating offline snapshot 1a3ffe71-9003-4751-8ad6-260a7ffe0114 of volume 1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:18:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Volume volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 (39589d76-32bf-4a43-b2a3-c9e6ae26be97): created successfully Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f096e95-5a41-4fb4-9f2a-7c2178f98f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Flow 'volume_create_manager' (571e30f2-430d-4335-9741-759e4e6bf06d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adbf6e4-f250-49fb-9984-28828be6c233]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-be7ca797-9bbe-4f77-b697-d06177c3d3ec tempest-VolumeDependencyTests-1774985197 None] Created volume successfully. Sep 28 19:18:12 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 Sep 28 19:18:12 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:12 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" returned: 0 in 0.407s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:12 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 1G Sep 28 19:18:12 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:13 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 1G" returned: 0 in 0.459s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:13 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 Sep 28 19:18:13 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:13 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114" returned: 0 in 0.433s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:13 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 is being set with open permissions: ugo+rw Sep 28 19:18:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:13 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 Sep 28 19:18:13 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:13 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114" returned: 0 in 0.273s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:14 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.info Sep 28 19:18:14 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:14 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.info" returned: 0 in 0.289s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:14 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.info is being set with open permissions: ugo+rw Sep 28 19:18:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:14 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.info Sep 28 19:18:14 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:14 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.info" returned: 0 in 0.301s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.973s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Creating offline snapshot 92c80797-c06e-44c5-a91e-2ce292424944 of volume 39589d76-32bf-4a43-b2a3-c9e6ae26be97 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:18:14 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddc30bf-c6a2-482b-a35e-c1e5d2bbeabd]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-26a6c0c0-3a83-461b-80f8-abfa502995db tempest-VolumesExtendTest-1463210403 None] Create snapshot completed successfully Sep 28 19:18:14 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 Sep 28 19:18:14 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:15 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97" returned: 0 in 0.406s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:15 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 1G Sep 28 19:18:15 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:15 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 1G" returned: 0 in 0.467s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:15 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 Sep 28 19:18:15 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ef9407c-883d-4695-9f35-a56f11f76fb5 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:15 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:15 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 is being set with open permissions: ugo+rw Sep 28 19:18:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:15 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 Sep 28 19:18:15 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:16 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944" returned: 0 in 0.282s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:16 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.info Sep 28 19:18:16 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:16 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.info" returned: 0 in 0.286s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:16 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.info is being set with open permissions: ugo+rw Sep 28 19:18:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:16 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.info Sep 28 19:18:16 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:16 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.info" returned: 0 in 0.266s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.147s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ef9407c-883d-4695-9f35-a56f11f76fb5 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.044s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97818e7-2233-44dd-948c-b209b692881b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ef9407c-883d-4695-9f35-a56f11f76fb5 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d829bc3b-f232-44f3-8b6e-5700d312a187 tempest-VolumeDependencyTests-1774985197 None] Create snapshot completed successfully Sep 28 19:18:16 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 Sep 28 19:18:16 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:17 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ef9407c-883d-4695-9f35-a56f11f76fb5 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" returned: 0 in 0.393s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ef9407c-883d-4695-9f35-a56f11f76fb5 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 2G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ef9407c-883d-4695-9f35-a56f11f76fb5 tempest-VolumesExtendTest-1463210403 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 2G" returned: 0 in 0.143s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ef9407c-883d-4695-9f35-a56f11f76fb5 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.579s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3ef9407c-883d-4695-9f35-a56f11f76fb5 tempest-VolumesExtendTest-1463210403 None] Extend volume completed successfully. Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "cinder-1a3ffe71-9003-4751-8ad6-260a7ffe0114-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-1a3ffe71-9003-4751-8ad6-260a7ffe0114-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "cinder-quobyte-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-quobyte-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "cinder-quobyte-1a3ffe71-9003-4751-8ad6-260a7ffe0114" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-quobyte-1a3ffe71-9003-4751-8ad6-260a7ffe0114" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Deleting offline snapshot 1a3ffe71-9003-4751-8ad6-260a7ffe0114 of volume 1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] snapshot_file for this snap is: volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4340a0ae-09c6-48f0-9db1-dc972a5dc7a9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:18 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 Sep 28 19:18:18 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Flow 'volume_create_manager' (5d71a545-cf01-405c-bf40-209490de374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:18 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90c2b9a-8630-4fd8-acb7-f86c0ce7bfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90c2b9a-8630-4fd8-acb7-f86c0ce7bfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-168332857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2120ec-48dd-4872-8b8f-b62f00743892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0040eb568cf94b73b85dc60295efc59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92c80797-c06e-44c5-a91e-2ce292424944,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:18Z,use_quota=True,user_id='bdfd009d191d4bb7911c551ab18c1b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3913d0f-7a97-4e61-9f30-1634110e810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3913d0f-7a97-4e61-9f30-1634110e810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2ec3ed-d8ae-45aa-8a70-2a2b2a11ebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2ec3ed-d8ae-45aa-8a70-2a2b2a11ebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f2120ec-48dd-4872-8b8f-b62f00743892', 'volume_name': 'volume-6f2120ec-48dd-4872-8b8f-b62f00743892', 'volume_size': 1, 'snapshot_id': '92c80797-c06e-44c5-a91e-2ce292424944'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5666f063-f93a-44c6-832b-98f1c0085551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5666f063-f93a-44c6-832b-98f1c0085551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b65239c-782d-4ffb-8346-5866184b486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:18 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Volume 6f2120ec-48dd-4872-8b8f-b62f00743892: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f2120ec-48dd-4872-8b8f-b62f00743892', 'volume_size': 1, 'snapshot_id': '92c80797-c06e-44c5-a91e-2ce292424944'} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4998dc-3941-4e50-8ed1-d13da113b9b0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "cinder-quobyte-92c80797-c06e-44c5-a91e-2ce292424944-6f2120ec-48dd-4872-8b8f-b62f00743892" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-92c80797-c06e-44c5-a91e-2ce292424944-6f2120ec-48dd-4872-8b8f-b62f00743892" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Creating volume 6f2120ec-48dd-4872-8b8f-b62f00743892 from snapshot 92c80797-c06e-44c5-a91e-2ce292424944 {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "cinder-quobyte-6f2120ec-48dd-4872-8b8f-b62f00743892" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-6f2120ec-48dd-4872-8b8f-b62f00743892" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] snapshot: 92c80797-c06e-44c5-a91e-2ce292424944, volume: 6f2120ec-48dd-4872-8b8f-b62f00743892, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f312a3b2-e3a5-4634-9ed3-21593b413a17]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:18 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 Sep 28 19:18:18 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:18 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 Sep 28 19:18:18 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:19 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" returned: 0 in 0.440s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:19 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 Sep 28 19:18:19 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:19 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944" returned: 0 in 0.437s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[021a1204-e869-4787-a22c-949825aec5c0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:19 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 Sep 28 19:18:19 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:19 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114" returned: 0 in 0.461s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:19 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114 Sep 28 19:18:19 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:19 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97" returned: 0 in 0.442s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:19 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 Sep 28 19:18:19 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:19 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7.1a3ffe71-9003-4751-8ad6-260a7ffe0114" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-quobyte-1a3ffe71-9003-4751-8ad6-260a7ffe0114" released by "_delete_snapshot" :: held 1.825s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-quobyte-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" released by "delete_snapshot" :: held 1.848s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:19 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Created reservations ['197f3be2-b99c-4de0-919c-df84425dcf52', 'cad59d8f-f1ea-4580-8704-ac759daa616f', '73f73a16-5069-412b-8b70-867fd3fb8710', 'd0d230d9-be24-4837-87d8-552823f4cff9'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Delete snapshot completed successfully. Sep 28 19:18:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ee26e8fb-83c5-4e85-b9fb-723cd66ee268 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-1a3ffe71-9003-4751-8ad6-260a7ffe0114-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "cinder-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "cinder-quobyte-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-quobyte-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c47f09-a2b4-495f-afbe-e4b79e3bc1e9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:20 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 Sep 28 19:18:20 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:21 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" returned: 0 in 0.716s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:21 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7 Sep 28 19:18:21 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:21 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" returned: 0 in 0.519s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-quobyte-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7" released by "delete_volume" :: held 1.400s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:21 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=98,cinder:UPDATE=110,cinder:INSERT=31,cinder:DELETE=10 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:18:21 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Created reservations ['142ff63d-86c5-4d82-8328-7b4b091e2983', '415f1cc3-55c2-4718-ad07-2b7c644b2577', 'd4dbd083-65f3-41ea-98c8-37561fa174ff', 'e10f4508-4d30-4f8d-a508-ab74a6c861e7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:22 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:22 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:22 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:22 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Deleted volume successfully. Sep 28 19:18:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3cd5745c-7466-4054-a7d1-9f4c0b7e2700 tempest-VolumesExtendTest-1463210403 None] Lock "cinder-1a6ab6a3-60c5-4fb6-af25-b131a6505ff7-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:26 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892" returned: 0 in 7.047s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:26 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:18:26 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Converted 1024.00 MB image at 145.28 MB/s Sep 28 19:18:26 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 is being set with open permissions: ugo+rw Sep 28 19:18:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:26 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 Sep 28 19:18:26 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:27 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892" returned: 0 in 0.253s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-6f2120ec-48dd-4872-8b8f-b62f00743892" released by "_copy_volume_from_snapshot" :: held 8.283s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=133,cinder:SELECT=92,cinder:INSERT=35,cinder:DELETE=10 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-92c80797-c06e-44c5-a91e-2ce292424944-6f2120ec-48dd-4872-8b8f-b62f00743892" released by "_create_volume_from_snapshot" :: held 8.358s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.378s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b65239c-782d-4ffb-8346-5866184b486e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2120ec-48dd-4872-8b8f-b62f00743892', 'volume_size': 1, 'snapshot_id': '92c80797-c06e-44c5-a91e-2ce292424944'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c02916e-ab29-4c0e-9601-714421cac19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Volume volume-6f2120ec-48dd-4872-8b8f-b62f00743892 (6f2120ec-48dd-4872-8b8f-b62f00743892): created successfully Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c02916e-ab29-4c0e-9601-714421cac19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Flow 'volume_create_manager' (5d71a545-cf01-405c-bf40-209490de374e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-16a4cee9-a921-46ce-89ed-937f898d2350 tempest-VolumeDependencyTests-1774985197 None] Created volume successfully. Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "cinder-92c80797-c06e-44c5-a91e-2ce292424944-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-92c80797-c06e-44c5-a91e-2ce292424944-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "cinder-quobyte-39589d76-32bf-4a43-b2a3-c9e6ae26be97" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-39589d76-32bf-4a43-b2a3-c9e6ae26be97" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "cinder-quobyte-92c80797-c06e-44c5-a91e-2ce292424944" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-92c80797-c06e-44c5-a91e-2ce292424944" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Deleting offline snapshot 92c80797-c06e-44c5-a91e-2ce292424944 of volume 39589d76-32bf-4a43-b2a3-c9e6ae26be97 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] snapshot_file for this snap is: volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[413271b3-2eb2-4868-a87d-5ffeafa5a280]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:27 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 Sep 28 19:18:27 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:27 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944" returned: 0 in 0.395s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab655a3f-0478-4542-966b-9987e3de48fb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:28 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 Sep 28 19:18:28 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Flow 'volume_create_manager' (08aa49ac-c7e9-4bc8-9cfb-ff34b21de599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbed92db-eece-4cb0-bdc0-d8cddf21a3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbed92db-eece-4cb0-bdc0-d8cddf21a3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1753328922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff8e17b-c3dc-4d06-aa7a-749f58a44f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e792c4af9f4fe4845665fb0b7d7c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:28Z,use_quota=True,user_id='3979c70aa3cd441691defef4ef343add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82e1bf6-6896-4bc0-9b69-88c8e07cb359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82e1bf6-6896-4bc0-9b69-88c8e07cb359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7766750a-deb9-4934-bed4-0c85e6cb07bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7766750a-deb9-4934-bed4-0c85e6cb07bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff8e17b-c3dc-4d06-aa7a-749f58a44f98', 'volume_name': 'volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bfe7ca-2e22-4526-bc56-44f08964a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bfe7ca-2e22-4526-bc56-44f08964a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2bb7d5-55f6-4d2b-865c-6dc994116df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Volume 3ff8e17b-c3dc-4d06-aa7a-749f58a44f98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98', 'volume_size': 1} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1753328922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff8e17b-c3dc-4d06-aa7a-749f58a44f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e792c4af9f4fe4845665fb0b7d7c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:28Z,use_quota=True,user_id='3979c70aa3cd441691defef4ef343add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Creating volume 3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:18:28 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:28 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 1073741824 Sep 28 19:18:28 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:28 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97" returned: 0 in 0.590s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:28 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 Sep 28 19:18:28 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:28 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 1073741824" returned: 0 in 0.444s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:28 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 Sep 28 19:18:28 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:28 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944" returned: 0 in 0.394s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:28 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944 Sep 28 19:18:28 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:29 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2bb7d5-55f6-4d2b-865c-6dc994116df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd70bf5a-b275-464a-a4ee-81c75c3720bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Volume volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 (3ff8e17b-c3dc-4d06-aa7a-749f58a44f98): created successfully Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd70bf5a-b275-464a-a4ee-81c75c3720bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Flow 'volume_create_manager' (08aa49ac-c7e9-4bc8-9cfb-ff34b21de599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-000ef1e2-aec2-4283-afb5-60fea3dc83d9 tempest-VolumesNegativeTest-1467618938 None] Created volume successfully. Sep 28 19:18:29 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97.92c80797-c06e-44c5-a91e-2ce292424944" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-92c80797-c06e-44c5-a91e-2ce292424944" released by "_delete_snapshot" :: held 1.766s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-39589d76-32bf-4a43-b2a3-c9e6ae26be97" released by "delete_snapshot" :: held 1.795s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Created reservations ['5d06b7cf-9a9d-416d-982c-6df96f226777', '412ca53a-501f-4991-8034-e23dc279a4de', 'df5003c0-805f-4296-975a-7b89eebde3ac', '910454b7-6fbe-4879-b9d9-f1574ec18e40'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Delete snapshot completed successfully. Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a2cdeb6f-6707-4a53-bc3c-b13440f7c5da tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-92c80797-c06e-44c5-a91e-2ce292424944-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "cinder-39589d76-32bf-4a43-b2a3-c9e6ae26be97-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-39589d76-32bf-4a43-b2a3-c9e6ae26be97-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "cinder-quobyte-39589d76-32bf-4a43-b2a3-c9e6ae26be97" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-39589d76-32bf-4a43-b2a3-c9e6ae26be97" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2902cde-c2c2-4b06-8f9e-8a392a1b1017]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:29 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 Sep 28 19:18:29 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:29 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:30 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97 Sep 28 19:18:30 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:30 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-39589d76-32bf-4a43-b2a3-c9e6ae26be97" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-39589d76-32bf-4a43-b2a3-c9e6ae26be97" released by "delete_volume" :: held 0.686s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Created reservations ['11d84a80-a148-4511-90e5-540aac1ecdbe', '47425e98-6212-4a33-b7ee-dc416e77d18f', '4880a70f-734c-40d3-a1c9-b19782d660bb', 'd1d32638-904b-4df3-8dfd-a2bc59b48e11'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:30 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:30 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "cinder-6f2120ec-48dd-4872-8b8f-b62f00743892-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:30 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-6f2120ec-48dd-4872-8b8f-b62f00743892-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Deleted volume successfully. Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1451897b-3628-4b8b-a2bf-e8850732064d tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-39589d76-32bf-4a43-b2a3-c9e6ae26be97-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "cinder-quobyte-6f2120ec-48dd-4872-8b8f-b62f00743892" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-6f2120ec-48dd-4872-8b8f-b62f00743892" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6311c46-48b2-4f95-ae73-9c042e16f0e5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:31 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 Sep 28 19:18:31 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:31 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892" returned: 0 in 0.439s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:31 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892 Sep 28 19:18:31 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:31 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6f2120ec-48dd-4872-8b8f-b62f00743892" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-quobyte-6f2120ec-48dd-4872-8b8f-b62f00743892" released by "delete_volume" :: held 0.767s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Created reservations ['843928dd-c16c-4ad9-b7c3-56c3c10e5048', '0e1e5c75-0f89-488a-9e65-5f5bc9e061d2', '718b19ef-18f5-4ff6-86d5-a039ed824770', '07b5db8b-c176-4a0a-8301-a2f5649eb7ff'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:31 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:31 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:32 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:32 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Deleted volume successfully. Sep 28 19:18:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b29db9f-c144-44a9-b775-b71238496bb5 tempest-VolumeDependencyTests-1774985197 None] Lock "cinder-6f2120ec-48dd-4872-8b8f-b62f00743892-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:34 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:34 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:34 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:18:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Flow 'volume_create_manager' (26b289bd-b5b5-4257-b920-006e88e880ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d05719-d06f-41a8-87a1-d0dd4f9242e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d05719-d06f-41a8-87a1-d0dd4f9242e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d87441-2244-438f-a03d-c65897fb2f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a64e353bbb94e8daae833a9c5a7c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:39Z,use_quota=True,user_id='cd8068cf046146e7b180a386f34c630a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa7de4d-c361-4daa-a31f-75dc94146455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa7de4d-c361-4daa-a31f-75dc94146455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6350ef4a-ca5a-4112-9581-7580be299108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6350ef4a-ca5a-4112-9581-7580be299108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9d87441-2244-438f-a03d-c65897fb2f12', 'volume_name': 'volume-c9d87441-2244-438f-a03d-c65897fb2f12', 'volume_size': 1, 'image_id': 'a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '229dd3229ae6457995badc62226f6e54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a64e353bbb94e8daae833a9c5a7c003', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3022141bfcf8cf82631cda35338cdec0f532ae667e5e58c7e51c7176418bdfdc39425c1c067afe3ec00ded35d1b8c710b1f7abbd7046454c7e3d163009685ed', 'id': 'a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'created_at': datetime.datetime(2026, 9, 28, 17, 18, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 18, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7bcb421-71d8-4c72-9b5a-faeb47df8728/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82b4b80-4934-4a3b-a59d-3fe005ddc512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82b4b80-4934-4a3b-a59d-3fe005ddc512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c087798b-5cbd-42ab-84cc-03d03617365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:39 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Volume c9d87441-2244-438f-a03d-c65897fb2f12: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9d87441-2244-438f-a03d-c65897fb2f12', 'volume_size': 1, 'image_id': 'a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '229dd3229ae6457995badc62226f6e54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a64e353bbb94e8daae833a9c5a7c003', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3022141bfcf8cf82631cda35338cdec0f532ae667e5e58c7e51c7176418bdfdc39425c1c067afe3ec00ded35d1b8c710b1f7abbd7046454c7e3d163009685ed', 'id': 'a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'created_at': datetime.datetime(2026, 9, 28, 17, 18, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 18, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7bcb421-71d8-4c72-9b5a-faeb47df8728/file', 'properties': {}}, 'image_service': } Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Trying to clone c9d87441-2244-438f-a03d-c65897fb2f12 from image a7bcb421-71d8-4c72-9b5a-faeb47df8728 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 19:18:39 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Image download 0.00 MB at 0.00 MB/s Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acfcf49-01cd-41fa-a8ac-f12798c6db41]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:40 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD Sep 28 19:18:40 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:40 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:40 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD Sep 28 19:18:40 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:40 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:18:40 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Temporary image a7bcb421-71d8-4c72-9b5a-faeb47df8728 is fetched for user cd8068cf046146e7b180a386f34c630a. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 19:18:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c19594f-4feb-4c8f-9dbd-83bc10c0a2d7]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:41 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD Sep 28 19:18:41 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:41 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:41 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD Sep 28 19:18:41 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:41 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d87441-2244-438f-a03d-c65897fb2f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a64e353bbb94e8daae833a9c5a7c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:39Z,use_quota=True,user_id='cd8068cf046146e7b180a386f34c630a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Creating volume c9d87441-2244-438f-a03d-c65897fb2f12 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:18:41 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:18:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:41 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 1073741824 Sep 28 19:18:41 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:42 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 1073741824" returned: 0 in 0.559s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:42 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 Sep 28 19:18:42 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:42 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:18:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:42 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Attempting download of a7bcb421-71d8-4c72-9b5a-faeb47df8728 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'metadata': {}}])) to volume c9d87441-2244-438f-a03d-c65897fb2f12. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 19:18:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8579aa9b-44dd-442b-a029-980a4ecc5fa6]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7bcb421-71d8-4c72-9b5a-faeb47df8728_0ve10fws {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:42 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7bcb421-71d8-4c72-9b5a-faeb47df8728_0ve10fws Sep 28 19:18:42 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:43 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7bcb421-71d8-4c72-9b5a-faeb47df8728_0ve10fws" returned: 0 in 0.356s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7bcb421-71d8-4c72-9b5a-faeb47df8728_0ve10fws {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:43 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7bcb421-71d8-4c72-9b5a-faeb47df8728_0ve10fws Sep 28 19:18:43 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:43 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7bcb421-71d8-4c72-9b5a-faeb47df8728_0ve10fws" returned: 1 in 0.409s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7bcb421-71d8-4c72-9b5a-faeb47df8728_0ve10fws' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:18:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f54c4-0aab-43c2-a937-08832b0a9d61]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:43 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD Sep 28 19:18:43 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:43 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:44 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD Sep 28 19:18:44 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:44 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:18:44 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] a7bcb421-71d8-4c72-9b5a-faeb47df8728 was raw, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 19:18:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:44 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 Sep 28 19:18:44 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:44 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12" returned: 0 in 0.560s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:44 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7bcb421-71d8-4c72-9b5a-faeb47df8728_ezglmk4cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:18:44 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 19:18:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:44 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 1G Sep 28 19:18:44 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:45 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 1G" returned: 0 in 0.366s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Downloaded image a7bcb421-71d8-4c72-9b5a-faeb47df8728 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'metadata': {}}])) to volume c9d87441-2244-438f-a03d-c65897fb2f12 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Temporary image a7bcb421-71d8-4c72-9b5a-faeb47df8728 for user cd8068cf046146e7b180a386f34c630a is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Marking volume c9d87441-2244-438f-a03d-c65897fb2f12 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Copying metadata from image a7bcb421-71d8-4c72-9b5a-faeb47df8728 to c9d87441-2244-438f-a03d-c65897fb2f12. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Creating volume glance metadata for volume c9d87441-2244-438f-a03d-c65897fb2f12 backed by image a7bcb421-71d8-4c72-9b5a-faeb47df8728 with: {'image_id': 'a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '229dd3229ae6457995badc62226f6e54', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c087798b-5cbd-42ab-84cc-03d03617365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d87441-2244-438f-a03d-c65897fb2f12', 'volume_size': 1, 'image_id': 'a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '229dd3229ae6457995badc62226f6e54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a64e353bbb94e8daae833a9c5a7c003', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3022141bfcf8cf82631cda35338cdec0f532ae667e5e58c7e51c7176418bdfdc39425c1c067afe3ec00ded35d1b8c710b1f7abbd7046454c7e3d163009685ed', 'id': 'a7bcb421-71d8-4c72-9b5a-faeb47df8728', 'created_at': datetime.datetime(2026, 9, 28, 17, 18, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 18, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7bcb421-71d8-4c72-9b5a-faeb47df8728/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40c29dc-b983-47d1-892a-d9a640bb9f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Volume volume-c9d87441-2244-438f-a03d-c65897fb2f12 (c9d87441-2244-438f-a03d-c65897fb2f12): created successfully Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40c29dc-b983-47d1-892a-d9a640bb9f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Flow 'volume_create_manager' (26b289bd-b5b5-4257-b920-006e88e880ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c26847c3-4c05-4161-ad78-6d8aecad3833 tempest-VolumeImageDependencyTests-1524464745 None] Created volume successfully. Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Acquiring lock "cinder-c9d87441-2244-438f-a03d-c65897fb2f12-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Lock "cinder-c9d87441-2244-438f-a03d-c65897fb2f12-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Acquiring lock "cinder-quobyte-c9d87441-2244-438f-a03d-c65897fb2f12" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Lock "cinder-quobyte-c9d87441-2244-438f-a03d-c65897fb2f12" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a00a49-843c-4529-a20d-80582b37e14b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:46 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 Sep 28 19:18:46 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:46 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:46 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12 Sep 28 19:18:46 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:46 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c9d87441-2244-438f-a03d-c65897fb2f12" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Lock "cinder-quobyte-c9d87441-2244-438f-a03d-c65897fb2f12" released by "delete_volume" :: held 0.759s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Created reservations ['d6a52fdd-8f83-473c-a412-5fd10d8fa59d', '899370fe-02ec-4a3f-914f-d83b7e9bd6a7', 'de4e2d08-3e67-462f-ab45-eed779c628e6', 'b283cedb-46bd-44be-bd23-41d091b5e72a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:46 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:46 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:47 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:47 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Deleted volume successfully. Sep 28 19:18:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a61d4549-a9f5-45a0-927e-c321df5231de tempest-VolumeImageDependencyTests-1524464745 None] Lock "cinder-c9d87441-2244-438f-a03d-c65897fb2f12-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Acquiring lock "cinder-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Lock "cinder-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Acquiring lock "cinder-quobyte-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Lock "cinder-quobyte-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ef3316-e0b6-4e6d-846a-9af3116fcb5a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:50 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 Sep 28 19:18:50 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:50 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98" returned: 0 in 0.405s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:50 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98 Sep 28 19:18:50 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:50 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98" returned: 0 in 0.248s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Lock "cinder-quobyte-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98" released by "delete_volume" :: held 0.699s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Created reservations ['06cd5410-be38-4472-babd-7854dca96d15', '64777834-d468-465b-bf9d-f217cd6f7b25', '9a879a91-f45a-4a71-b89a-041862953784', '784e705c-45ce-479d-bd8d-e0516aa38424'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:50 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:18:50 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:51 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.262s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:51 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:18:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Deleted volume successfully. Sep 28 19:18:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0dcb90f-59c6-4831-be52-9b9a7069f972 tempest-VolumesNegativeTest-1467618938 None] Lock "cinder-3ff8e17b-c3dc-4d06-aa7a-749f58a44f98-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Flow 'volume_create_manager' (3ed1ee97-1af1-4462-ab16-154896b72f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b62946e-6030-4689-9c8d-7019c966fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b62946e-6030-4689-9c8d-7019c966fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1877035766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dd9d05-eee6-4bff-a788-5650a8d78e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42196472bfe947babc3b6a48b2cef90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:55Z,use_quota=True,user_id='d9eb23ed038a43399b9fcacbf1c54931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac40ce0-db02-43fa-b6c3-7f74c2aca229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac40ce0-db02-43fa-b6c3-7f74c2aca229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68474baa-5973-4e2d-8972-fb639018da32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68474baa-5973-4e2d-8972-fb639018da32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95dd9d05-eee6-4bff-a788-5650a8d78e08', 'volume_name': 'volume-95dd9d05-eee6-4bff-a788-5650a8d78e08', 'volume_size': 2}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72304813-1999-4382-b0c3-56e602a25152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72304813-1999-4382-b0c3-56e602a25152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93db1e5b-b716-46ef-a5dc-c3dfff63be13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Volume 95dd9d05-eee6-4bff-a788-5650a8d78e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95dd9d05-eee6-4bff-a788-5650a8d78e08', 'volume_size': 2} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1877035766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dd9d05-eee6-4bff-a788-5650a8d78e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42196472bfe947babc3b6a48b2cef90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:18:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:18:55Z,use_quota=True,user_id='d9eb23ed038a43399b9fcacbf1c54931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Creating volume 95dd9d05-eee6-4bff-a788-5650a8d78e08 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:18:54 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:18:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 2147483648 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:54 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 2147483648 Sep 28 19:18:54 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:55 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 2147483648" returned: 0 in 0.520s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:55 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 Sep 28 19:18:55 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:55 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:18:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93db1e5b-b716-46ef-a5dc-c3dfff63be13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dd9d05-eee6-4bff-a788-5650a8d78e08', 'volume_size': 2}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b32fe5-dfbc-4556-a254-c7a8db2281f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:18:55 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Volume volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 (95dd9d05-eee6-4bff-a788-5650a8d78e08): created successfully Sep 28 19:18:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b32fe5-dfbc-4556-a254-c7a8db2281f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:18:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Flow 'volume_create_manager' (3ed1ee97-1af1-4462-ab16-154896b72f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:18:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-66c1d8c7-c5fe-4403-a53b-b8e0767c54de tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Created volume successfully. Sep 28 19:18:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:18:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:18:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Creating offline snapshot 0447c55a-6732-4fe5-8c9b-7be941bda28f of volume 95dd9d05-eee6-4bff-a788-5650a8d78e08 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:18:57 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b546d8de-4161-4335-90fb-7a7736b29af3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:18:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:57 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 Sep 28 19:18:57 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:57 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f 2G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:57 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f 2G Sep 28 19:18:57 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:58 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f 2G" returned: 0 in 0.465s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:58 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f Sep 28 19:18:58 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:58 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:58 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f is being set with open permissions: ugo+rw Sep 28 19:18:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:58 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f Sep 28 19:18:58 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:58 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:58 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.info Sep 28 19:18:58 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:58 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.info" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:58 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.info is being set with open permissions: ugo+rw Sep 28 19:18:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:18:59 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.info Sep 28 19:18:59 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:18:59 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 28 19:18:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.info" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:18:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:18:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3e6e479d-4112-4d80-9097-db8f10382cb2 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Create snapshot completed successfully Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Acquiring lock "cinder-0447c55a-6732-4fe5-8c9b-7be941bda28f-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "cinder-0447c55a-6732-4fe5-8c9b-7be941bda28f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Acquiring lock "cinder-quobyte-95dd9d05-eee6-4bff-a788-5650a8d78e08" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "cinder-quobyte-95dd9d05-eee6-4bff-a788-5650a8d78e08" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Acquiring lock "cinder-quobyte-0447c55a-6732-4fe5-8c9b-7be941bda28f" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "cinder-quobyte-0447c55a-6732-4fe5-8c9b-7be941bda28f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Deleting offline snapshot 0447c55a-6732-4fe5-8c9b-7be941bda28f of volume 95dd9d05-eee6-4bff-a788-5650a8d78e08 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] snapshot_file for this snap is: volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e178ac-06c5-4554-80d0-334210d6daff]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:19:00 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f Sep 28 19:19:00 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:19:00 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dd9d05-eee6-4bff-a788-5650a8d78e08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92086f6-a5e9-4e7a-913a-bcd7fe43f15e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:19:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:19:01 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 Sep 28 19:19:01 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:19:01 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 28 19:19:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:19:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:19:01 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f Sep 28 19:19:01 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:19:01 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Sep 28 19:19:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f" returned: 0 in 0.392s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:19:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:19:01 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f Sep 28 19:19:01 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:19:02 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08.0447c55a-6732-4fe5-8c9b-7be941bda28f" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "cinder-quobyte-0447c55a-6732-4fe5-8c9b-7be941bda28f" released by "_delete_snapshot" :: held 1.604s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "cinder-quobyte-95dd9d05-eee6-4bff-a788-5650a8d78e08" released by "delete_snapshot" :: held 1.631s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Created reservations ['e6ccac8c-ed73-415c-80d0-a7922d436c31', 'a0cd4c8d-f171-49b3-ad45-7a5fac340eb9', '613a9336-ae1d-4c84-9efc-7ea391314752', '7d3d438f-1b0f-441c-80bc-701e55c7407d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:19:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Delete snapshot completed successfully. Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48eaa7d4-6239-4598-8c19-99b6e79f82ec tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "cinder-0447c55a-6732-4fe5-8c9b-7be941bda28f-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Acquiring lock "cinder-95dd9d05-eee6-4bff-a788-5650a8d78e08-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "cinder-95dd9d05-eee6-4bff-a788-5650a8d78e08-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Acquiring lock "cinder-quobyte-95dd9d05-eee6-4bff-a788-5650a8d78e08" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "cinder-quobyte-95dd9d05-eee6-4bff-a788-5650a8d78e08" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e542b389-e1dd-431f-88a9-4fd868bb3c3a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:19:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:19:02 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 Sep 28 19:19:02 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:19:03 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:19:03 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08 Sep 28 19:19:03 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:19:03 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95dd9d05-eee6-4bff-a788-5650a8d78e08" returned: 0 in 0.270s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "cinder-quobyte-95dd9d05-eee6-4bff-a788-5650a8d78e08" released by "delete_volume" :: held 0.750s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Created reservations ['f415e4f5-c47e-4927-a95a-2aa39a86c258', 'bb6bc8d2-885c-49f0-9bf1-99f35ba4307a', '983139dc-dc83-4d46-baec-cbadf31632ea', 'd83e3647-a740-4906-bedc-0236db8882e8'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:19:03 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:19:03 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:19:03 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:19:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Deleted volume successfully. Sep 28 19:19:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf809005-59ee-4280-9d24-a831c2fb8f62 tempest-VolumesSnapshotNegativeTestJSON-463344730 None] Lock "cinder-95dd9d05-eee6-4bff-a788-5650a8d78e08-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:19:13 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=63,cinder:SELECT=61,cinder:INSERT=21,cinder:DELETE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:19:13 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=48,cinder:INSERT=23,cinder:UPDATE=73,cinder:DELETE=9 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:19:34 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:19:34 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:19:34 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.332s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:19:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Flow 'volume_create_manager' (92d00f5c-2d32-49ce-ace9-bb9b4f38ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac522b6-5b65-48cf-80bf-25a26a2482b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac522b6-5b65-48cf-80bf-25a26a2482b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-863470331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6e755a-5826-40ec-80e2-06157b290309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='153a7f836186468991900e8f1bfdf18e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:19:41Z,use_quota=True,user_id='529416e6071546989091aac31e54f594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001779e1-bcc2-4e72-878f-a9ac3e668bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001779e1-bcc2-4e72-878f-a9ac3e668bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe9a620-53ea-4e76-b5cc-c1ce80c9b537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe9a620-53ea-4e76-b5cc-c1ce80c9b537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6e755a-5826-40ec-80e2-06157b290309', 'volume_name': 'volume-8a6e755a-5826-40ec-80e2-06157b290309', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b514ed13-b646-4be6-aac9-0099a21ed2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b514ed13-b646-4be6-aac9-0099a21ed2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fd9bc4-ac2d-48fc-8747-fb81c77c0119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:19:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Volume 8a6e755a-5826-40ec-80e2-06157b290309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6e755a-5826-40ec-80e2-06157b290309', 'volume_size': 1} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-863470331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6e755a-5826-40ec-80e2-06157b290309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='153a7f836186468991900e8f1bfdf18e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:19:41Z,use_quota=True,user_id='529416e6071546989091aac31e54f594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Creating volume 8a6e755a-5826-40ec-80e2-06157b290309 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:19:41 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:19:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:19:41 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309 1073741824 Sep 28 19:19:41 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:19:42 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Sep 28 19:19:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309 1073741824" returned: 0 in 0.515s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:19:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:19:42 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309 Sep 28 19:19:42 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:19:42 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Sep 28 19:19:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309" returned: 0 in 0.278s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:19:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:19:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:19:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fd9bc4-ac2d-48fc-8747-fb81c77c0119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6e755a-5826-40ec-80e2-06157b290309', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:19:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70df9d12-18cc-4923-bb91-39c251c2273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:19:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Volume volume-8a6e755a-5826-40ec-80e2-06157b290309 (8a6e755a-5826-40ec-80e2-06157b290309): created successfully Sep 28 19:19:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70df9d12-18cc-4923-bb91-39c251c2273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:19:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Flow 'volume_create_manager' (92d00f5c-2d32-49ce-ace9-bb9b4f38ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:19:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a210b04d-fb61-4471-b618-3b733e4c8a6b tempest-TestMinimumBasicScenario-1410265098 None] Created volume successfully. Sep 28 19:19:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-c4688886-4de6-4ca1-a427-0a0246a71bb1 req-718a1514-db61-4a8b-b2c3-1b385784b2f9 tempest-TestMinimumBasicScenario-1410265098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:19:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-c4688886-4de6-4ca1-a427-0a0246a71bb1 req-718a1514-db61-4a8b-b2c3-1b385784b2f9 tempest-TestMinimumBasicScenario-1410265098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:19:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-c4688886-4de6-4ca1-a427-0a0246a71bb1 req-718a1514-db61-4a8b-b2c3-1b385784b2f9 tempest-TestMinimumBasicScenario-1410265098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:19:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-c4688886-4de6-4ca1-a427-0a0246a71bb1 req-718a1514-db61-4a8b-b2c3-1b385784b2f9 tempest-TestMinimumBasicScenario-1410265098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-8a6e755a-5826-40ec-80e2-06157b290309', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fcc0b69-616e-4171-8575-ef22467a508e', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:19:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-c4688886-4de6-4ca1-a427-0a0246a71bb1 req-718a1514-db61-4a8b-b2c3-1b385784b2f9 tempest-TestMinimumBasicScenario-1410265098 None] attachment_update completed successfully. Sep 28 19:19:54 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:19:54 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:20:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-429c142e-4e8e-4c70-bd54-390cb157e083 req-98ccbf28-a0da-47cd-8d2c-1960d42b9c18 tempest-TestMinimumBasicScenario-1410265098 None] Terminate volume connection completed successfully. Sep 28 19:20:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-429c142e-4e8e-4c70-bd54-390cb157e083 req-98ccbf28-a0da-47cd-8d2c-1960d42b9c18 tempest-TestMinimumBasicScenario-1410265098 None] Deleting attachment 1fcc0b69-616e-4171-8575-ef22467a508e. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Acquiring lock "cinder-8a6e755a-5826-40ec-80e2-06157b290309-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Lock "cinder-8a6e755a-5826-40ec-80e2-06157b290309-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Acquiring lock "cinder-quobyte-8a6e755a-5826-40ec-80e2-06157b290309" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Lock "cinder-quobyte-8a6e755a-5826-40ec-80e2-06157b290309" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50ba3bc-afd2-48e6-bdea-920f8e550260]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:20:31 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309 Sep 28 19:20:31 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:20:31 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309" returned: 0 in 0.383s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:20:31 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309 Sep 28 19:20:31 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:20:31 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-8a6e755a-5826-40ec-80e2-06157b290309" returned: 0 in 0.250s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Lock "cinder-quobyte-8a6e755a-5826-40ec-80e2-06157b290309" released by "delete_volume" :: held 0.677s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Created reservations ['1e35b125-9bd4-4d67-95a8-ee6d2af2bb4a', 'fd2f5400-4167-47fc-bf86-b0229cd2eecb', '8999c6c1-17e5-468a-adf4-c1a340cfdbed', 'f9138ddf-1642-4343-9c3d-8d8d6fa655e2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:20:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:20:31 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:20:31 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:20:32 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Sep 28 19:20:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:20:32 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:20:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Deleted volume successfully. Sep 28 19:20:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-72f3abb4-6d47-4bc5-a2fc-101fe4310b03 tempest-TestMinimumBasicScenario-1410265098 None] Lock "cinder-8a6e755a-5826-40ec-80e2-06157b290309-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:20:34 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:20:34 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:20:34 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.290s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:20:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:20:41 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:20:42 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Flow 'volume_create_manager' (7e0ebaa3-b06c-4c19-bf9b-30a93eef7923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f6cf5d-7b88-4cd0-9988-e74db0f2325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f6cf5d-7b88-4cd0-9988-e74db0f2325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-833596679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b6b905-8b5d-4009-b8a9-286d1ad3543f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40ae17c0e2b406684e2e0d990b81e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:21:07Z,use_quota=True,user_id='38542b268e2a498cb9c6b90871acf85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43c6530-196c-4288-9f9c-1fa2a13fb3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43c6530-196c-4288-9f9c-1fa2a13fb3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294d793e-cd64-466f-81cb-47f0e72c5537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294d793e-cd64-466f-81cb-47f0e72c5537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b6b905-8b5d-4009-b8a9-286d1ad3543f', 'volume_name': 'volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8422ce60-4f3e-458d-8528-ce4d79d96ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8422ce60-4f3e-458d-8528-ce4d79d96ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e965c614-78b3-4deb-8a9f-be3231f25af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Volume 40b6b905-8b5d-4009-b8a9-286d1ad3543f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f', 'volume_size': 1} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-833596679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b6b905-8b5d-4009-b8a9-286d1ad3543f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40ae17c0e2b406684e2e0d990b81e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:21:07Z,use_quota=True,user_id='38542b268e2a498cb9c6b90871acf85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Creating volume 40b6b905-8b5d-4009-b8a9-286d1ad3543f {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:21:07 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:07 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f 1073741824 Sep 28 19:21:07 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Flow 'volume_create_manager' (ba2fb8e8-1ff9-49d7-8dd8-aecea0606709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3a1d6c-e459-4a45-ab79-6ecaf7c726c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3a1d6c-e459-4a45-ab79-6ecaf7c726c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-820324448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55db6d2c-6796-4fbd-8568-53c5da51148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40ae17c0e2b406684e2e0d990b81e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:21:08Z,use_quota=True,user_id='38542b268e2a498cb9c6b90871acf85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886b8c1b-c60a-4e9e-b1ae-77a8945e1191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886b8c1b-c60a-4e9e-b1ae-77a8945e1191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5769d6de-3d13-4221-b055-71eb34e3a0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5769d6de-3d13-4221-b055-71eb34e3a0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55db6d2c-6796-4fbd-8568-53c5da51148e', 'volume_name': 'volume-55db6d2c-6796-4fbd-8568-53c5da51148e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b7f353-e62a-4f33-b2f4-420ee5d593ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b7f353-e62a-4f33-b2f4-420ee5d593ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8c81a4-8994-4517-a7a8-7ddfa87147ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Volume 55db6d2c-6796-4fbd-8568-53c5da51148e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55db6d2c-6796-4fbd-8568-53c5da51148e', 'volume_size': 1} Sep 28 19:21:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:21:08 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f 1073741824" returned: 0 in 0.541s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:08 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f Sep 28 19:21:08 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:08 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-820324448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55db6d2c-6796-4fbd-8568-53c5da51148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40ae17c0e2b406684e2e0d990b81e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:21:08Z,use_quota=True,user_id='38542b268e2a498cb9c6b90871acf85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Creating volume 55db6d2c-6796-4fbd-8568-53c5da51148e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:21:08 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e965c614-78b3-4deb-8a9f-be3231f25af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f660534c-83d8-4394-b6f4-d8c8513dc94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:08 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e 1073741824 Sep 28 19:21:08 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Volume volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f (40b6b905-8b5d-4009-b8a9-286d1ad3543f): created successfully Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f660534c-83d8-4394-b6f4-d8c8513dc94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Flow 'volume_create_manager' (7e0ebaa3-b06c-4c19-bf9b-30a93eef7923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:21:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3a538ccb-3bf7-4ea1-b7e2-0e5e7fc4e635 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Created volume successfully. Sep 28 19:21:08 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e 1073741824" returned: 0 in 0.536s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:08 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e Sep 28 19:21:08 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:09 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:21:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:21:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8c81a4-8994-4517-a7a8-7ddfa87147ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55db6d2c-6796-4fbd-8568-53c5da51148e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb9eb5f-11ac-495f-ada4-2d1cb72c11b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:21:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Volume volume-55db6d2c-6796-4fbd-8568-53c5da51148e (55db6d2c-6796-4fbd-8568-53c5da51148e): created successfully Sep 28 19:21:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb9eb5f-11ac-495f-ada4-2d1cb72c11b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:21:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Flow 'volume_create_manager' (ba2fb8e8-1ff9-49d7-8dd8-aecea0606709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:21:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-563b5fa6-fd20-4e56-9f42-02dc1500da8e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Created volume successfully. Sep 28 19:21:19 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=6,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:21:19 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:34 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:21:34 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:34 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.253s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:21:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:21:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-18e50876-d704-43c7-b194-7e2bad3a7b11 req-1694cfad-c6ae-4fd7-8087-866308e2f85c tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:21:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-18e50876-d704-43c7-b194-7e2bad3a7b11 req-1694cfad-c6ae-4fd7-8087-866308e2f85c tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:21:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-18e50876-d704-43c7-b194-7e2bad3a7b11 req-1694cfad-c6ae-4fd7-8087-866308e2f85c tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:21:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-18e50876-d704-43c7-b194-7e2bad3a7b11 req-1694cfad-c6ae-4fd7-8087-866308e2f85c tempest-TestServerVolumeAttachmentScenario-1296521551 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a52487a8-8120-4649-828f-327562b7e7fb', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:21:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-18e50876-d704-43c7-b194-7e2bad3a7b11 req-1694cfad-c6ae-4fd7-8087-866308e2f85c tempest-TestServerVolumeAttachmentScenario-1296521551 None] attachment_update completed successfully. Sep 28 19:21:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4acb77d9-3a78-4ab4-8e76-604b09a36b35 req-4e980785-6d28-4957-a6da-05eb12d0bbd5 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:21:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4acb77d9-3a78-4ab4-8e76-604b09a36b35 req-4e980785-6d28-4957-a6da-05eb12d0bbd5 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:21:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4acb77d9-3a78-4ab4-8e76-604b09a36b35 req-4e980785-6d28-4957-a6da-05eb12d0bbd5 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:21:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-4acb77d9-3a78-4ab4-8e76-604b09a36b35 req-4e980785-6d28-4957-a6da-05eb12d0bbd5 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-55db6d2c-6796-4fbd-8568-53c5da51148e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc9e88b1-95f2-4b88-8e42-4d26bbaac8f8', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:21:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-4acb77d9-3a78-4ab4-8e76-604b09a36b35 req-4e980785-6d28-4957-a6da-05eb12d0bbd5 tempest-TestServerVolumeAttachmentScenario-1296521551 None] attachment_update completed successfully. Sep 28 19:21:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-e62fbeb1-e895-4104-9c64-1aa3fe66065b req-b0edba40-d625-4644-9bba-bb5463b64763 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Terminate volume connection completed successfully. Sep 28 19:21:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-e62fbeb1-e895-4104-9c64-1aa3fe66065b req-b0edba40-d625-4644-9bba-bb5463b64763 tempest-TestServerVolumeAttachmentScenario-1296521551 None] Deleting attachment dc9e88b1-95f2-4b88-8e42-4d26bbaac8f8. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:21:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-b64d5c6d-7d2c-4ca3-9523-4cd203b23a5a req-f957c5f1-fdae-406d-ba96-c532359b41db tempest-TestServerVolumeAttachmentScenario-1296521551 None] Terminate volume connection completed successfully. Sep 28 19:21:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-b64d5c6d-7d2c-4ca3-9523-4cd203b23a5a req-f957c5f1-fdae-406d-ba96-c532359b41db tempest-TestServerVolumeAttachmentScenario-1296521551 None] Deleting attachment a52487a8-8120-4649-828f-327562b7e7fb. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:21:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "cinder-55db6d2c-6796-4fbd-8568-53c5da51148e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:21:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "cinder-55db6d2c-6796-4fbd-8568-53c5da51148e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:21:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "cinder-quobyte-55db6d2c-6796-4fbd-8568-53c5da51148e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:21:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "cinder-quobyte-55db6d2c-6796-4fbd-8568-53c5da51148e" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:21:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcae67fa-80bb-448d-9989-fdbf05620b05]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:21:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:53 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e Sep 28 19:21:53 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:53 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:53 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e Sep 28 19:21:53 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:54 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-55db6d2c-6796-4fbd-8568-53c5da51148e" returned: 0 in 0.250s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "cinder-quobyte-55db6d2c-6796-4fbd-8568-53c5da51148e" released by "delete_volume" :: held 0.718s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Created reservations ['1c15ec01-b5df-4564-ba96-635dbae8d250', '24fd7e5f-9111-401a-99c8-227e5e2fd236', 'd37b373c-d181-468c-95ca-40b3c2999e22', '9c52301e-6502-45d5-8d38-c9707ec6cf85'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:54 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:21:54 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "cinder-40b6b905-8b5d-4009-b8a9-286d1ad3543f-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:21:54 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.292s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "cinder-40b6b905-8b5d-4009-b8a9-286d1ad3543f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:21:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Deleted volume successfully. Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c416abf3-bda3-4839-9637-fca0bb73d39e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "cinder-55db6d2c-6796-4fbd-8568-53c5da51148e-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "cinder-quobyte-40b6b905-8b5d-4009-b8a9-286d1ad3543f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "cinder-quobyte-40b6b905-8b5d-4009-b8a9-286d1ad3543f" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5f9fc7-dd96-461d-8731-86331de2b967]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:21:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:54 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f Sep 28 19:21:54 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:55 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f" returned: 0 in 0.427s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:55 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f Sep 28 19:21:55 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:55 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-40b6b905-8b5d-4009-b8a9-286d1ad3543f" returned: 0 in 0.265s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "cinder-quobyte-40b6b905-8b5d-4009-b8a9-286d1ad3543f" released by "delete_volume" :: held 0.735s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Created reservations ['c91e861a-7660-44d4-9b77-4e1eab3b6170', 'fe86d02a-9369-4eb2-9615-67f19495df6c', '925118d6-872b-453f-b306-70646e3782e3', 'b282a770-c938-49ba-8882-d3096cc49839'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:21:55 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:21:55 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:21:55 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.269s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:21:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Deleted volume successfully. Sep 28 19:21:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d681b409-f102-45eb-8ceb-3eeb8faa2d5e tempest-TestServerVolumeAttachmentScenario-1296521551 None] Lock "cinder-40b6b905-8b5d-4009-b8a9-286d1ad3543f-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:22:05 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=27,cinder:UPDATE=20,cinder:INSERT=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:22:05 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=23,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Flow 'volume_create_manager' (b433eb6a-8a6b-4688-a302-b7ae9835d5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e1c48a-1b94-45c5-9785-5244edaee16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e1c48a-1b94-45c5-9785-5244edaee16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1909566111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9572928b4e84e2181e73b801715fc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:22:31Z,use_quota=True,user_id='78bf358af8a04485b20c45edf03e9fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c0b05e-18e9-406a-ba09-26af49a62386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c0b05e-18e9-406a-ba09-26af49a62386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e201e855-871c-4f84-b28b-e3610cfc9186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e201e855-871c-4f84-b28b-e3610cfc9186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1', 'volume_name': 'volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e04df6-b75d-4668-8110-6c2107a2a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e04df6-b75d-4668-8110-6c2107a2a716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65b5105-58bb-4da0-8165-8f487d459673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:22:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Volume c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1', 'volume_size': 1} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1909566111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9572928b4e84e2181e73b801715fc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:22:31Z,use_quota=True,user_id='78bf358af8a04485b20c45edf03e9fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Creating volume c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:22:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:22:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:22:31 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 1073741824 Sep 28 19:22:31 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:22:32 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 28 19:22:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 1073741824" returned: 0 in 0.486s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:22:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:22:32 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 Sep 28 19:22:32 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:22:32 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Sep 28 19:22:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:22:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:22:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:22:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65b5105-58bb-4da0-8165-8f487d459673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:22:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035e49fe-0f88-49e5-a981-99bb9897bf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:22:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Volume volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 (c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1): created successfully Sep 28 19:22:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035e49fe-0f88-49e5-a981-99bb9897bf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:22:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Flow 'volume_create_manager' (b433eb6a-8a6b-4688-a302-b7ae9835d5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:22:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-abdc7475-2a09-403d-9d0e-e8215f643e30 tempest-TestStampPattern-1082937598 None] Created volume successfully. Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:22:34 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:22:34 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:22:34 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:22:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:22:42 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:22:42 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:23:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-17f83761-1d52-4d93-9eb9-e38ef4598a24 req-784370fa-ee29-4ed9-acf5-522e68b914cf tempest-TestStampPattern-1082937598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:23:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-17f83761-1d52-4d93-9eb9-e38ef4598a24 req-784370fa-ee29-4ed9-acf5-522e68b914cf tempest-TestStampPattern-1082937598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:23:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-17f83761-1d52-4d93-9eb9-e38ef4598a24 req-784370fa-ee29-4ed9-acf5-522e68b914cf tempest-TestStampPattern-1082937598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:23:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-17f83761-1d52-4d93-9eb9-e38ef4598a24 req-784370fa-ee29-4ed9-acf5-522e68b914cf tempest-TestStampPattern-1082937598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30c7c61d-2943-4b71-b952-a779bd657c1a', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:23:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-17f83761-1d52-4d93-9eb9-e38ef4598a24 req-784370fa-ee29-4ed9-acf5-522e68b914cf tempest-TestStampPattern-1082937598 None] attachment_update completed successfully. Sep 28 19:23:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-774607e7-b9c4-4e37-a9a7-703d1fc79262 req-d9d884ac-03a6-4fd3-b904-ae02e144fede tempest-TestStampPattern-1082937598 None] Terminate volume connection completed successfully. Sep 28 19:23:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-774607e7-b9c4-4e37-a9a7-703d1fc79262 req-d9d884ac-03a6-4fd3-b904-ae02e144fede tempest-TestStampPattern-1082937598 None] Deleting attachment 30c7c61d-2943-4b71-b952-a779bd657c1a. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:23:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:23:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:23:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Creating offline snapshot e9f07172-c7b7-4002-b431-0a31b79db3da of volume c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:23:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee7df5b-1243-4ef3-848f-a88471ec29e2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:23:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:10 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 Sep 28 19:23:10 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:10 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" returned: 0 in 0.387s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:10 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da 1G Sep 28 19:23:10 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:10 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da 1G" returned: 0 in 0.428s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:10 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da Sep 28 19:23:10 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:11 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da" returned: 0 in 0.365s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:11 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da is being set with open permissions: ugo+rw Sep 28 19:23:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:11 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da Sep 28 19:23:11 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:11 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:11 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.info Sep 28 19:23:11 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:11 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.info" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:11 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.info is being set with open permissions: ugo+rw Sep 28 19:23:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:11 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.info Sep 28 19:23:11 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:12 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.info" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:23:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ecdee482-a321-47e1-b4e6-de86a42996a1 tempest-TestStampPattern-1082937598 None] Create snapshot completed successfully Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Flow 'volume_create_manager' (971b6257-fc1a-4bd8-add5-0e8bc99dca62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff2b59f-376a-4556-9ae5-963edd646d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff2b59f-376a-4556-9ae5-963edd646d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1805804948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7df50e-3995-4378-89fa-ae7ae0067b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9572928b4e84e2181e73b801715fc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e9f07172-c7b7-4002-b431-0a31b79db3da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:23:20Z,use_quota=True,user_id='78bf358af8a04485b20c45edf03e9fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc54239-dc02-4080-b1e4-f2f74473e38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc54239-dc02-4080-b1e4-f2f74473e38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e447f500-5018-4645-97a2-9531ec2a8d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e447f500-5018-4645-97a2-9531ec2a8d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc7df50e-3995-4378-89fa-ae7ae0067b72', 'volume_name': 'volume-bc7df50e-3995-4378-89fa-ae7ae0067b72', 'volume_size': 1, 'snapshot_id': 'e9f07172-c7b7-4002-b431-0a31b79db3da'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a3b048-477c-4484-8bd2-48341f52a519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a3b048-477c-4484-8bd2-48341f52a519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9739c5f-541b-4c9d-8569-7bc37e794134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:23:20 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Volume bc7df50e-3995-4378-89fa-ae7ae0067b72: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc7df50e-3995-4378-89fa-ae7ae0067b72', 'volume_size': 1, 'snapshot_id': 'e9f07172-c7b7-4002-b431-0a31b79db3da'} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Acquiring lock "cinder-quobyte-e9f07172-c7b7-4002-b431-0a31b79db3da-bc7df50e-3995-4378-89fa-ae7ae0067b72" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-e9f07172-c7b7-4002-b431-0a31b79db3da-bc7df50e-3995-4378-89fa-ae7ae0067b72" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Creating volume bc7df50e-3995-4378-89fa-ae7ae0067b72 from snapshot e9f07172-c7b7-4002-b431-0a31b79db3da {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Acquiring lock "cinder-quobyte-bc7df50e-3995-4378-89fa-ae7ae0067b72" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-bc7df50e-3995-4378-89fa-ae7ae0067b72" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] snapshot: e9f07172-c7b7-4002-b431-0a31b79db3da, volume: bc7df50e-3995-4378-89fa-ae7ae0067b72, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62560b9-979f-444b-bbcb-3cc0beac8c24]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:20 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da Sep 28 19:23:20 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:20 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da" returned: 0 in 0.426s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbc6827-fec6-4f56-895c-0990032eec41]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:23:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:20 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 Sep 28 19:23:20 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:21 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" returned: 0 in 0.462s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:23:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:23:21 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:23:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:21 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 Sep 28 19:23:21 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=6,cinder:SELECT=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=18,cinder:UPDATE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:23:30 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72" returned: 0 in 9.324s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:23:30 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Converted 1024.00 MB image at 109.78 MB/s Sep 28 19:23:30 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 is being set with open permissions: ugo+rw Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:30 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 Sep 28 19:23:30 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:30 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-bc7df50e-3995-4378-89fa-ae7ae0067b72" released by "_copy_volume_from_snapshot" :: held 10.619s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-e9f07172-c7b7-4002-b431-0a31b79db3da-bc7df50e-3995-4378-89fa-ae7ae0067b72" released by "_create_volume_from_snapshot" :: held 10.707s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.728s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9739c5f-541b-4c9d-8569-7bc37e794134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7df50e-3995-4378-89fa-ae7ae0067b72', 'volume_size': 1, 'snapshot_id': 'e9f07172-c7b7-4002-b431-0a31b79db3da'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:23:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31ff0ba-7ca7-4a74-9d87-694c513ddf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:23:30 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Volume volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 (bc7df50e-3995-4378-89fa-ae7ae0067b72): created successfully Sep 28 19:23:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31ff0ba-7ca7-4a74-9d87-694c513ddf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:23:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Flow 'volume_create_manager' (971b6257-fc1a-4bd8-add5-0e8bc99dca62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:23:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5b245c6b-2591-43e9-b055-eb46f197cb97 tempest-TestStampPattern-1082937598 None] Created volume successfully. Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:23:34 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:23:34 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:23:34 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:23:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:23:41 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:23:41 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:23:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-f3a7e833-660a-47dd-a847-6ff6cc50f173 req-7671761b-fb17-4dee-bc3c-52f741d70239 tempest-TestStampPattern-1082937598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:23:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-f3a7e833-660a-47dd-a847-6ff6cc50f173 req-7671761b-fb17-4dee-bc3c-52f741d70239 tempest-TestStampPattern-1082937598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:23:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-f3a7e833-660a-47dd-a847-6ff6cc50f173 req-7671761b-fb17-4dee-bc3c-52f741d70239 tempest-TestStampPattern-1082937598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:23:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-f3a7e833-660a-47dd-a847-6ff6cc50f173 req-7671761b-fb17-4dee-bc3c-52f741d70239 tempest-TestStampPattern-1082937598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca', 'name': 'volume-bc7df50e-3995-4378-89fa-ae7ae0067b72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f912984-41f4-496c-a8c6-d82d43b2e443', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 19:23:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-f3a7e833-660a-47dd-a847-6ff6cc50f173 req-7671761b-fb17-4dee-bc3c-52f741d70239 tempest-TestStampPattern-1082937598 None] attachment_update completed successfully. Sep 28 19:24:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-93088068-f95f-4748-9fa7-a780f93fc8a4 req-207be3c4-c534-40f4-a3cc-cfe5b53f90d1 tempest-TestStampPattern-1082937598 None] Terminate volume connection completed successfully. Sep 28 19:24:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-93088068-f95f-4748-9fa7-a780f93fc8a4 req-207be3c4-c534-40f4-a3cc-cfe5b53f90d1 tempest-TestStampPattern-1082937598 None] Deleting attachment 1f912984-41f4-496c-a8c6-d82d43b2e443. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Acquiring lock "cinder-bc7df50e-3995-4378-89fa-ae7ae0067b72-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Lock "cinder-bc7df50e-3995-4378-89fa-ae7ae0067b72-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Acquiring lock "cinder-quobyte-bc7df50e-3995-4378-89fa-ae7ae0067b72" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-bc7df50e-3995-4378-89fa-ae7ae0067b72" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ee74c8-a027-4e15-9211-f5d0620644e8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:07 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 Sep 28 19:24:07 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:07 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72" returned: 0 in 0.400s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:07 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72 Sep 28 19:24:07 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:07 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-bc7df50e-3995-4378-89fa-ae7ae0067b72" returned: 0 in 0.258s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-bc7df50e-3995-4378-89fa-ae7ae0067b72" released by "delete_volume" :: held 0.708s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Created reservations ['f7389125-04eb-48d2-a664-1ddc7c6b7adf', 'a9adeda4-4ba5-4e71-b567-87f8ab231e92', 'faf587f1-be2c-4386-9335-7b729e213f05', 'ebbf94d6-1cc7-4f82-913d-a46bd0833ba2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:07 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:24:07 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:08 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:24:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Deleted volume successfully. Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d0cdd783-0aa4-45ff-96d8-e3b610098e70 tempest-TestStampPattern-1082937598 None] Lock "cinder-bc7df50e-3995-4378-89fa-ae7ae0067b72-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Acquiring lock "cinder-e9f07172-c7b7-4002-b431-0a31b79db3da-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Lock "cinder-e9f07172-c7b7-4002-b431-0a31b79db3da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Acquiring lock "cinder-quobyte-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Acquiring lock "cinder-quobyte-e9f07172-c7b7-4002-b431-0a31b79db3da" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-e9f07172-c7b7-4002-b431-0a31b79db3da" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Deleting offline snapshot e9f07172-c7b7-4002-b431-0a31b79db3da of volume c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] snapshot_file for this snap is: volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7e54b-babd-470e-97f7-7ff7f99364bf]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:24:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:08 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da Sep 28 19:24:08 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:09 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:24:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4f2621-df58-4039-bac6-72591e69a96c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:24:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:09 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 Sep 28 19:24:09 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:09 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" returned: 0 in 0.577s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:09 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da Sep 28 19:24:09 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:10 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da" returned: 0 in 0.360s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:10 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da Sep 28 19:24:10 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:10 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1.e9f07172-c7b7-4002-b431-0a31b79db3da" returned: 0 in 0.261s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-e9f07172-c7b7-4002-b431-0a31b79db3da" released by "_delete_snapshot" :: held 1.725s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" released by "delete_snapshot" :: held 1.754s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:10 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Created reservations ['aecb9ff7-7748-484c-bc06-563fa705f848', 'd263bccd-59ce-4bf4-ae46-adb66704e8a4', '96ebcfb1-f07c-4c29-853e-81704ac39591', '2c24bb20-abdd-4808-bf7a-afdfac75b04c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:24:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Delete snapshot completed successfully. Sep 28 19:24:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c8e7e304-bfb6-4813-ba4a-9170e45d44e7 tempest-TestStampPattern-1082937598 None] Lock "cinder-e9f07172-c7b7-4002-b431-0a31b79db3da-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Acquiring lock "cinder-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Lock "cinder-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Acquiring lock "cinder-quobyte-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:14 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e877120-1b2b-4dd4-a2d5-389be11fb62f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:24:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:14 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 Sep 28 19:24:14 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:15 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" returned: 0 in 0.412s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:15 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1 Sep 28 19:24:15 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:15 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" returned: 0 in 0.264s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Lock "cinder-quobyte-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1" released by "delete_volume" :: held 0.745s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Created reservations ['76ece974-a61c-47c3-85dd-36de303cd035', '8acdfd46-1faa-4c02-a2bc-5db39b490f2d', 'd275a628-aa1a-47db-add0-50459c3e8792', '64d2249d-6993-4c31-930d-c544838c0dcb'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:15 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:24:15 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:15 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.269s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:24:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Deleted volume successfully. Sep 28 19:24:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9864d95d-ca94-4627-8db5-683cd4001327 tempest-TestStampPattern-1082937598 None] Lock "cinder-c00d4a46-7fed-4fb2-b3a7-a587f08e1cf1-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:25 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=19,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:24:25 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=27,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Flow 'volume_create_manager' (5e1b45e1-4127-4af4-8328-faaa5a71796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c258334-ddcb-46a7-8a08-6a852a4f64ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c258334-ddcb-46a7-8a08-6a852a4f64ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1458178738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70409ed4-46e0-4d84-bc66-b3786f46f421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c658a63540349c59234dd6c1d843db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:24:29Z,use_quota=True,user_id='beea225e5cb34f85a29c6fe6d915fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4522e7-8633-41dc-8000-a3d058ca1b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4522e7-8633-41dc-8000-a3d058ca1b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd79e3ec-8222-4b93-9dc2-3b9f689fd431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd79e3ec-8222-4b93-9dc2-3b9f689fd431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70409ed4-46e0-4d84-bc66-b3786f46f421', 'volume_name': 'volume-70409ed4-46e0-4d84-bc66-b3786f46f421', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f342f33c-83e5-4fa9-99ef-9f0f89cdfe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f342f33c-83e5-4fa9-99ef-9f0f89cdfe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6668dbc-ffd0-4314-a5f5-a63bb44272a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Volume 70409ed4-46e0-4d84-bc66-b3786f46f421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70409ed4-46e0-4d84-bc66-b3786f46f421', 'volume_size': 1} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1458178738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70409ed4-46e0-4d84-bc66-b3786f46f421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c658a63540349c59234dd6c1d843db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:24:29Z,use_quota=True,user_id='beea225e5cb34f85a29c6fe6d915fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Creating volume 70409ed4-46e0-4d84-bc66-b3786f46f421 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:24:28 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:24:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:29 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421 1073741824 Sep 28 19:24:29 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Flow 'volume_create_manager' (cf4368a0-b466-48ec-846e-7c8d236f1cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64221d6-2678-462f-963e-a9f2e23f96d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64221d6-2678-462f-963e-a9f2e23f96d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724034026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d756719-2413-4245-b20d-dfe23404175a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c658a63540349c59234dd6c1d843db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:24:29Z,use_quota=True,user_id='beea225e5cb34f85a29c6fe6d915fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed50ba6b-795b-45ae-a44d-29044960a35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed50ba6b-795b-45ae-a44d-29044960a35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e5f906-5f66-4a3c-ad00-19e17d9a8789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e5f906-5f66-4a3c-ad00-19e17d9a8789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d756719-2413-4245-b20d-dfe23404175a', 'volume_name': 'volume-4d756719-2413-4245-b20d-dfe23404175a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d63641-0fd0-414a-aa65-ab1d9da54592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d63641-0fd0-414a-aa65-ab1d9da54592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb52b2e-8598-4372-807a-b703917e31ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Volume 4d756719-2413-4245-b20d-dfe23404175a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d756719-2413-4245-b20d-dfe23404175a', 'volume_size': 1} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:29 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421 1073741824" returned: 0 in 0.552s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:29 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421 Sep 28 19:24:29 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Flow 'volume_create_manager' (e10cb42a-6c4d-41a1-982e-8c44b88c8285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d901fa0-d113-407f-ae51-1a2db0b98eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d901fa0-d113-407f-ae51-1a2db0b98eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1188214869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf3b0fa-fe9e-4ca5-85fd-484386480592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c658a63540349c59234dd6c1d843db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:24:30Z,use_quota=True,user_id='beea225e5cb34f85a29c6fe6d915fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf23518-a807-4805-9fb2-c8bfe2ae3f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf23518-a807-4805-9fb2-c8bfe2ae3f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f609c081-efc4-4135-a826-50c841281ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f609c081-efc4-4135-a826-50c841281ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf3b0fa-fe9e-4ca5-85fd-484386480592', 'volume_name': 'volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e3d138-bbf3-4d74-b711-f570caf9121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e3d138-bbf3-4d74-b711-f570caf9121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6238638d-b3e0-45c4-8eda-8e6fa6bf332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Volume fcf3b0fa-fe9e-4ca5-85fd-484386480592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592', 'volume_size': 1} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:29 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421" returned: 0 in 0.290s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724034026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d756719-2413-4245-b20d-dfe23404175a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c658a63540349c59234dd6c1d843db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:24:29Z,use_quota=True,user_id='beea225e5cb34f85a29c6fe6d915fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Creating volume 4d756719-2413-4245-b20d-dfe23404175a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:24:29 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6668dbc-ffd0-4314-a5f5-a63bb44272a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70409ed4-46e0-4d84-bc66-b3786f46f421', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:29 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a 1073741824 Sep 28 19:24:29 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f32c954-e421-45e0-83de-566db2be60b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Volume volume-70409ed4-46e0-4d84-bc66-b3786f46f421 (70409ed4-46e0-4d84-bc66-b3786f46f421): created successfully Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f32c954-e421-45e0-83de-566db2be60b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Flow 'volume_create_manager' (5e1b45e1-4127-4af4-8328-faaa5a71796e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:24:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-111e3e10-372f-4e5b-84f6-c51b3f6876ea tempest-CreateVolumesFromImageTest-757596573 None] Created volume successfully. Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Flow 'volume_create_manager' (4ad22c38-56d8-4dbe-85fa-c5cf902972e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb26a65-5c73-4d5c-9659-1475905d4c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb26a65-5c73-4d5c-9659-1475905d4c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2093695872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4120acf-f225-462e-ade7-014b99627d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c658a63540349c59234dd6c1d843db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:24:30Z,use_quota=True,user_id='beea225e5cb34f85a29c6fe6d915fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5ce572-a08d-40de-bf32-91939a4a7857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5ce572-a08d-40de-bf32-91939a4a7857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a86afb-78b8-4168-af6a-853cdd025621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a86afb-78b8-4168-af6a-853cdd025621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4120acf-f225-462e-ade7-014b99627d78', 'volume_name': 'volume-e4120acf-f225-462e-ade7-014b99627d78', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b218ff12-0a88-49b1-9306-0a2ebb3f94aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b218ff12-0a88-49b1-9306-0a2ebb3f94aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f987540-073b-4885-8277-08244c623914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Volume e4120acf-f225-462e-ade7-014b99627d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4120acf-f225-462e-ade7-014b99627d78', 'volume_size': 1} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:30 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a 1073741824" returned: 0 in 0.597s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:30 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a Sep 28 19:24:30 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Flow 'volume_create_manager' (032bf6b2-517d-4b03-aab2-9e59ef06a461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1beb8059-b2fc-400e-a8f4-fa566a4cf3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1beb8059-b2fc-400e-a8f4-fa566a4cf3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070200862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c658a63540349c59234dd6c1d843db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:24:31Z,use_quota=True,user_id='beea225e5cb34f85a29c6fe6d915fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d18e764-5b18-491d-bd15-2106d0a0739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d18e764-5b18-491d-bd15-2106d0a0739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8048eeb-55c1-4662-93c8-b6421c0ac969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8048eeb-55c1-4662-93c8-b6421c0ac969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed', 'volume_name': 'volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afaedb92-0424-4431-a20c-fa970cdbddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afaedb92-0424-4431-a20c-fa970cdbddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bd31d7-fc7d-4229-b7d8-f2cb7310bb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Volume a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed', 'volume_size': 1} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:30 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.064s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1188214869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf3b0fa-fe9e-4ca5-85fd-484386480592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c658a63540349c59234dd6c1d843db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:24:30Z,use_quota=True,user_id='beea225e5cb34f85a29c6fe6d915fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Creating volume fcf3b0fa-fe9e-4ca5-85fd-484386480592 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:24:30 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb52b2e-8598-4372-807a-b703917e31ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d756719-2413-4245-b20d-dfe23404175a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:30 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592 1073741824 Sep 28 19:24:30 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b2460a-02a0-4c4d-a69a-5a9f472cefde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:30 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Volume volume-4d756719-2413-4245-b20d-dfe23404175a (4d756719-2413-4245-b20d-dfe23404175a): created successfully Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b2460a-02a0-4c4d-a69a-5a9f472cefde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Flow 'volume_create_manager' (cf4368a0-b466-48ec-846e-7c8d236f1cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:24:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dcf7721f-2b43-4fa9-a2d4-c16d18b2c544 tempest-CreateVolumesFromImageTest-757596573 None] Created volume successfully. Sep 28 19:24:31 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592 1073741824" returned: 0 in 0.472s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:31 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592 Sep 28 19:24:31 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:31 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2093695872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4120acf-f225-462e-ade7-014b99627d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c658a63540349c59234dd6c1d843db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:24:30Z,use_quota=True,user_id='beea225e5cb34f85a29c6fe6d915fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Creating volume e4120acf-f225-462e-ade7-014b99627d78 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:24:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:31 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78 1073741824 Sep 28 19:24:31 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6238638d-b3e0-45c4-8eda-8e6fa6bf332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24b4e76-163c-48e3-afd6-d3aab0650600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Volume volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592 (fcf3b0fa-fe9e-4ca5-85fd-484386480592): created successfully Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24b4e76-163c-48e3-afd6-d3aab0650600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Flow 'volume_create_manager' (e10cb42a-6c4d-41a1-982e-8c44b88c8285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:24:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b2e6088b-deea-40f6-aca9-00f63c8bfce6 tempest-CreateVolumesFromImageTest-757596573 None] Created volume successfully. Sep 28 19:24:32 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78 1073741824" returned: 0 in 0.454s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:32 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78 Sep 28 19:24:32 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:32 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78" returned: 0 in 0.254s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070200862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c658a63540349c59234dd6c1d843db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:24:31Z,use_quota=True,user_id='beea225e5cb34f85a29c6fe6d915fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Creating volume a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:24:32 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f987540-073b-4885-8277-08244c623914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4120acf-f225-462e-ade7-014b99627d78', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:32 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed 1073741824 Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3d92aa-939b-455a-986a-e9fb793089a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:32 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Volume volume-e4120acf-f225-462e-ade7-014b99627d78 (e4120acf-f225-462e-ade7-014b99627d78): created successfully Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3d92aa-939b-455a-986a-e9fb793089a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Flow 'volume_create_manager' (4ad22c38-56d8-4dbe-85fa-c5cf902972e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:24:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b3350442-99ec-48c9-8e06-9e33de12ca78 tempest-CreateVolumesFromImageTest-757596573 None] Created volume successfully. Sep 28 19:24:32 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed 1073741824" returned: 0 in 0.483s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:32 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed Sep 28 19:24:32 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:33 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed" returned: 0 in 0.262s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:24:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bd31d7-fc7d-4229-b7d8-f2cb7310bb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9c65e7-dbcb-4a4b-8a80-bdde91fdabb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:24:33 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Volume volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed (a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed): created successfully Sep 28 19:24:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9c65e7-dbcb-4a4b-8a80-bdde91fdabb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:24:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Flow 'volume_create_manager' (032bf6b2-517d-4b03-aab2-9e59ef06a461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:24:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b706bffd-53cb-42b0-8866-c7ee89551f9f tempest-CreateVolumesFromImageTest-757596573 None] Created volume successfully. Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "cinder-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "cinder-quobyte-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-quobyte-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e51fb4-0b0a-4e00-ac3a-5ebb5eeb5cc2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:34 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed Sep 28 19:24:34 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:34 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed" returned: 0 in 0.381s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:34 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed Sep 28 19:24:34 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:34 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:24:34 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:34 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed" returned: 0 in 0.251s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-quobyte-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed" released by "delete_volume" :: held 0.680s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Created reservations ['f8fdf6e2-5f4d-40fd-aa33-650fcb3d5c13', 'e3370b53-dce5-43b5-bc51-8c92871f6452', '1f1992b9-04fc-41ca-9752-f42e8d661d6d', '889978fc-357e-4d6f-a40a-90470e32b90f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:34 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.303s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:24:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:24:34 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:24:34 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:35 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.271s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "cinder-e4120acf-f225-462e-ade7-014b99627d78-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Deleted volume successfully. Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-e4120acf-f225-462e-ade7-014b99627d78-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-faceea5a-0838-419f-853c-5cc202f3b9e2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-a1a98c65-b0d8-43c1-8133-69b1fd8ef0ed-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "cinder-quobyte-e4120acf-f225-462e-ade7-014b99627d78" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-quobyte-e4120acf-f225-462e-ade7-014b99627d78" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be67952-aecf-45a4-9adb-31b60ed68912]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:35 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78 Sep 28 19:24:35 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:35 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78" returned: 0 in 0.417s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:35 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78 Sep 28 19:24:35 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:36 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e4120acf-f225-462e-ade7-014b99627d78" returned: 0 in 0.280s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-quobyte-e4120acf-f225-462e-ade7-014b99627d78" released by "delete_volume" :: held 0.742s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Created reservations ['ecb8a538-8338-4f8e-849a-17c43689d531', '21c6326e-d2c3-4f93-bf34-fe0c3dbe9288', '2088f39b-026f-490d-96b7-a782d0898fc5', 'f1459729-c578-4e0f-b9c8-2266ae6bfc94'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:36 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:24:36 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "cinder-fcf3b0fa-fe9e-4ca5-85fd-484386480592-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-fcf3b0fa-fe9e-4ca5-85fd-484386480592-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:36 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:24:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Deleted volume successfully. Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "cinder-quobyte-fcf3b0fa-fe9e-4ca5-85fd-484386480592" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b2828a09-93ae-447d-9819-a07e44d9f721 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-e4120acf-f225-462e-ade7-014b99627d78-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-quobyte-fcf3b0fa-fe9e-4ca5-85fd-484386480592" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb048908-ad9b-428a-942d-4e3370f036ce]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:36 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592 Sep 28 19:24:36 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:36 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592" returned: 0 in 0.405s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:36 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592 Sep 28 19:24:36 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:37 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-fcf3b0fa-fe9e-4ca5-85fd-484386480592" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-quobyte-fcf3b0fa-fe9e-4ca5-85fd-484386480592" released by "delete_volume" :: held 0.723s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Created reservations ['b5783aad-97d4-48bf-ae2f-8cb4b7a679ab', '8d77de80-5cb7-45da-9b56-47f6679e0153', '3c7d12ea-177d-4144-9922-8aff3387c543', 'f6571e8a-873d-4a8d-86c4-f490e8da93db'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:37 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:24:37 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "cinder-4d756719-2413-4245-b20d-dfe23404175a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-4d756719-2413-4245-b20d-dfe23404175a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "cinder-quobyte-4d756719-2413-4245-b20d-dfe23404175a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:37 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:24:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Deleted volume successfully. Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-quobyte-4d756719-2413-4245-b20d-dfe23404175a" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caecb64a-3879-4e0a-b549-9f219f74e9b9 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-fcf3b0fa-fe9e-4ca5-85fd-484386480592-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f23fc66-e673-4dfa-a17d-f7379ce7dc0f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:24:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:37 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a Sep 28 19:24:37 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:38 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:38 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a Sep 28 19:24:38 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:38 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-4d756719-2413-4245-b20d-dfe23404175a" returned: 0 in 0.285s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-quobyte-4d756719-2413-4245-b20d-dfe23404175a" released by "delete_volume" :: held 0.746s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Created reservations ['64cc85cf-ec85-4faf-906c-f52c39a6dda7', '9028fa9d-ed2d-4315-aa5b-6c860bfe4365', '41ffe8bc-aed8-495e-bdfc-ffc0bf6c7846', 'bad857b0-f555-4e1c-8e79-c739bed421d2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:38 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:24:38 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "cinder-70409ed4-46e0-4d84-bc66-b3786f46f421-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-70409ed4-46e0-4d84-bc66-b3786f46f421-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:38 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "cinder-quobyte-70409ed4-46e0-4d84-bc66-b3786f46f421" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:24:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Deleted volume successfully. Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-quobyte-70409ed4-46e0-4d84-bc66-b3786f46f421" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4c090d3a-d553-4597-98da-ad6ea95754d2 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-4d756719-2413-4245-b20d-dfe23404175a-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a59c598-89d5-492f-bd13-68ee04b53109]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:24:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:39 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421 Sep 28 19:24:39 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:39 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421" returned: 0 in 0.406s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:39 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421 Sep 28 19:24:39 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:39 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70409ed4-46e0-4d84-bc66-b3786f46f421" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-quobyte-70409ed4-46e0-4d84-bc66-b3786f46f421" released by "delete_volume" :: held 0.721s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Created reservations ['2e932dff-b472-4ccc-9dbf-24500e3006c5', 'f4562463-fa5d-4535-b7f6-9c668300599f', '2d584d30-529f-4af9-a672-5072521299eb', 'f4b203df-cff7-4b4c-a349-c4faa5c2ef75'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:24:39 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:24:39 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:24:39 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.255s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:24:39 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:24:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Deleted volume successfully. Sep 28 19:24:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7d53de3a-359c-4619-825c-dd0dbbf03fb1 tempest-CreateVolumesFromImageTest-757596573 None] Lock "cinder-70409ed4-46e0-4d84-bc66-b3786f46f421-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:24:49 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=53,cinder:SELECT=29,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:24:50 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=41,cinder:UPDATE=57,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Flow 'volume_create_manager' (d14f15a3-74ba-4dd7-9ac2-cfc7759a55fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9b511d-9f3d-45b6-a69e-3f7aefac7db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9b511d-9f3d-45b6-a69e-3f7aefac7db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1812461839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8f2e8297a149dd83ed6ef8ab549747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:03Z,use_quota=True,user_id='fe228d340d7640b6abfc33e58c166398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823a8528-7dbb-4f1e-a7bb-a10eb1e2e643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823a8528-7dbb-4f1e-a7bb-a10eb1e2e643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d3b685-cdd9-49ae-a820-a8d25c22e000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d3b685-cdd9-49ae-a820-a8d25c22e000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4', 'volume_name': 'volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c69850b-8df0-4776-8849-fd7ad6299af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c69850b-8df0-4776-8849-fd7ad6299af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2634e7e4-4ae1-4ed3-9db9-68a292d4f134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:03 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Volume 5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4', 'volume_size': 1} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1812461839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8f2e8297a149dd83ed6ef8ab549747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:03Z,use_quota=True,user_id='fe228d340d7640b6abfc33e58c166398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Creating volume 5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:03 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:03 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 1073741824 Sep 28 19:25:03 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (67f81236-119c-44c9-89d3-0cd0dcf25448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32393a62-1aea-4e4e-98b9-4489b1148e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32393a62-1aea-4e4e-98b9-4489b1148e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411153452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a40dba-3240-4040-bc54-58a5810bbc58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:04Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73aa59d-e067-4e4d-a3bc-6f78b5d49475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73aa59d-e067-4e4d-a3bc-6f78b5d49475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2c4643-f962-497d-ae65-996d892bbc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2c4643-f962-497d-ae65-996d892bbc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a40dba-3240-4040-bc54-58a5810bbc58', 'volume_name': 'volume-54a40dba-3240-4040-bc54-58a5810bbc58', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8918d4-d314-4345-b166-7540f80788c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8918d4-d314-4345-b166-7540f80788c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb35d26-5f64-4568-b632-4568a6aa7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume 54a40dba-3240-4040-bc54-58a5810bbc58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a40dba-3240-4040-bc54-58a5810bbc58', 'volume_size': 1} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 1073741824" returned: 0 in 0.972s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Flow 'volume_create_manager' (bb6ff5bd-3d3f-43fd-aa44-7b62a4075cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5122fab9-1669-4350-b080-e43e0917ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5122fab9-1669-4350-b080-e43e0917ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2060551153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b9c790-58c1-46a6-82d4-7f78920a44f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8f2e8297a149dd83ed6ef8ab549747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:04Z,use_quota=True,user_id='fe228d340d7640b6abfc33e58c166398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26623c2-6836-42c6-be3f-8b44011cc01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26623c2-6836-42c6-be3f-8b44011cc01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbdf266-7bae-4de7-92a1-d5e7a85217cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbdf266-7bae-4de7-92a1-d5e7a85217cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b9c790-58c1-46a6-82d4-7f78920a44f9', 'volume_name': 'volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9af210-1495-4c26-ac74-bea1b3ab22e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9af210-1495-4c26-ac74-bea1b3ab22e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08478e15-c0f7-48f5-a601-f60959dcbecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Volume b0b9c790-58c1-46a6-82d4-7f78920a44f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9', 'volume_size': 1} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Flow 'volume_create_manager' (eac6a7f5-b7cd-4a2b-9ef3-cb45d07ce409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5366a153-89aa-4a62-906b-d84a3403a1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5366a153-89aa-4a62-906b-d84a3403a1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-404061738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e765f62-9f6d-4adb-a80c-c17ab305d2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8f2e8297a149dd83ed6ef8ab549747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:04Z,use_quota=True,user_id='fe228d340d7640b6abfc33e58c166398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a724b4-b240-44e6-a866-d9f4659daa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a724b4-b240-44e6-a866-d9f4659daa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12eabdc5-30dd-458e-b99e-c2eb94802e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12eabdc5-30dd-458e-b99e-c2eb94802e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e765f62-9f6d-4adb-a80c-c17ab305d2fd', 'volume_name': 'volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b630ba-011e-44e0-9462-4d7e4c98ad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b630ba-011e-44e0-9462-4d7e4c98ad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4357aa77-47ce-48ca-9c69-2de6a30ee4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Volume 5e765f62-9f6d-4adb-a80c-c17ab305d2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd', 'volume_size': 1} Sep 28 19:25:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:05 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4" returned: 0 in 0.538s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.799s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411153452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a40dba-3240-4040-bc54-58a5810bbc58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:04Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Creating volume 54a40dba-3240-4040-bc54-58a5810bbc58 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:05 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2634e7e4-4ae1-4ed3-9db9-68a292d4f134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58 1073741824 Sep 28 19:25:05 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebea023-b053-4ddb-915b-3332c4789af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Volume volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 (5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4): created successfully Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebea023-b053-4ddb-915b-3332c4789af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Flow 'volume_create_manager' (d14f15a3-74ba-4dd7-9ac2-cfc7759a55fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0e59944c-da72-4c5f-a7c0-b9d35a6e3090 tempest-CreateVolumesFromImageTest-1321262300 None] Created volume successfully. Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (5eacb8eb-d8a6-435a-81c8-b58a37ac2ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c5d6ed-66a5-484e-8356-3f7982cda1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c5d6ed-66a5-484e-8356-3f7982cda1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-143445168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6642426b-d6d2-4740-971f-8163430c4326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:05Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e2e322-79f8-4e0c-9b6f-af3de0301024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e2e322-79f8-4e0c-9b6f-af3de0301024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506533fd-b7ee-472d-8d23-42aba8619bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506533fd-b7ee-472d-8d23-42aba8619bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6642426b-d6d2-4740-971f-8163430c4326', 'volume_name': 'volume-6642426b-d6d2-4740-971f-8163430c4326', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389418f0-ae3b-47a7-97f6-2933a282ffb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389418f0-ae3b-47a7-97f6-2933a282ffb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b536deaa-689a-4df1-9ad1-b356d6f7f617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Volume 6642426b-d6d2-4740-971f-8163430c4326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6642426b-d6d2-4740-971f-8163430c4326', 'volume_size': 1} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Flow 'volume_create_manager' (27e36929-4e41-49ad-be66-66cb71713441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cca5c2a-979a-4648-ab0e-69c57c515218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cca5c2a-979a-4648-ab0e-69c57c515218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-984684274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0a7122-1027-4684-bef3-ef51a1346c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8f2e8297a149dd83ed6ef8ab549747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:05Z,use_quota=True,user_id='fe228d340d7640b6abfc33e58c166398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec31ac8f-7541-4372-bc44-a9b975405eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec31ac8f-7541-4372-bc44-a9b975405eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa61b9e7-077a-4e22-9994-c91db5d0a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa61b9e7-077a-4e22-9994-c91db5d0a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce0a7122-1027-4684-bef3-ef51a1346c4b', 'volume_name': 'volume-ce0a7122-1027-4684-bef3-ef51a1346c4b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6bd3931-3eca-44d3-a3db-34d5c104e5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6bd3931-3eca-44d3-a3db-34d5c104e5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a1c02d-a9bf-4871-b4be-9b964cffbff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Volume ce0a7122-1027-4684-bef3-ef51a1346c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce0a7122-1027-4684-bef3-ef51a1346c4b', 'volume_size': 1} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Flow 'volume_create_manager' (99bfca89-99c4-4d3b-be8c-fac2468e100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a650438a-28e4-4638-ae3e-bfdeeda2763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a650438a-28e4-4638-ae3e-bfdeeda2763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-419323971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318dae98-567b-4313-bd66-9277ab27f065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8f2e8297a149dd83ed6ef8ab549747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:06Z,use_quota=True,user_id='fe228d340d7640b6abfc33e58c166398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02161c2-3b07-4b69-be4a-0c6bf837cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02161c2-3b07-4b69-be4a-0c6bf837cb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e007f6-5f4c-41ca-95f9-2642b3b2a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e007f6-5f4c-41ca-95f9-2642b3b2a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318dae98-567b-4313-bd66-9277ab27f065', 'volume_name': 'volume-318dae98-567b-4313-bd66-9277ab27f065', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b7e0a5-f1ae-451b-b777-0cc6a00d5c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b7e0a5-f1ae-451b-b777-0cc6a00d5c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f48c249-2605-418c-ac4f-26d264b8feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Volume 318dae98-567b-4313-bd66-9277ab27f065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318dae98-567b-4313-bd66-9277ab27f065', 'volume_size': 1} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58 1073741824" returned: 0 in 0.698s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:06 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58 Sep 28 19:25:06 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:06 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2060551153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b9c790-58c1-46a6-82d4-7f78920a44f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8f2e8297a149dd83ed6ef8ab549747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:04Z,use_quota=True,user_id='fe228d340d7640b6abfc33e58c166398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Creating volume b0b9c790-58c1-46a6-82d4-7f78920a44f9 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:06 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb35d26-5f64-4568-b632-4568a6aa7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a40dba-3240-4040-bc54-58a5810bbc58', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:06 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9 1073741824 Sep 28 19:25:06 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853f02cd-3310-4b00-b46c-ac9f653f8f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:06 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume volume-54a40dba-3240-4040-bc54-58a5810bbc58 (54a40dba-3240-4040-bc54-58a5810bbc58): created successfully Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853f02cd-3310-4b00-b46c-ac9f653f8f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (67f81236-119c-44c9-89d3-0cd0dcf25448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-80221145-76b7-48f2-8f0d-fbc83a9d8a1c tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created volume successfully. Sep 28 19:25:06 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9 1073741824" returned: 0 in 0.552s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:06 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9 Sep 28 19:25:06 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:07 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9" returned: 0 in 0.355s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.437s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-404061738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e765f62-9f6d-4adb-a80c-c17ab305d2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8f2e8297a149dd83ed6ef8ab549747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:04Z,use_quota=True,user_id='fe228d340d7640b6abfc33e58c166398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Creating volume 5e765f62-9f6d-4adb-a80c-c17ab305d2fd {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:07 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:07 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd 1073741824 Sep 28 19:25:07 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08478e15-c0f7-48f5-a601-f60959dcbecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab3c03d-2a75-4e8a-bab6-aa1772083292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Volume volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9 (b0b9c790-58c1-46a6-82d4-7f78920a44f9): created successfully Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab3c03d-2a75-4e8a-bab6-aa1772083292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Flow 'volume_create_manager' (bb6ff5bd-3d3f-43fd-aa44-7b62a4075cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fc7c5034-4430-4eac-8bed-510dd8f7bb74 tempest-CreateVolumesFromImageTest-1321262300 None] Created volume successfully. Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (f66141d7-d3df-44c2-b9ea-d5f5c1d5f2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c142aec4-b282-48cc-a10d-49f201837916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c142aec4-b282-48cc-a10d-49f201837916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947505157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c89012-c715-4499-8408-56ef657aed50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:08Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024f580e-1fea-44fe-8931-4f61916b9edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024f580e-1fea-44fe-8931-4f61916b9edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715b04ed-bcf9-4cd4-b8f8-b1c7f241f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715b04ed-bcf9-4cd4-b8f8-b1c7f241f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c89012-c715-4499-8408-56ef657aed50', 'volume_name': 'volume-a7c89012-c715-4499-8408-56ef657aed50', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea2476d-1047-441e-99ac-1bc28ca718d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea2476d-1047-441e-99ac-1bc28ca718d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb3c47b-4b9f-42b0-b2bb-e768a08009b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume a7c89012-c715-4499-8408-56ef657aed50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c89012-c715-4499-8408-56ef657aed50', 'volume_size': 1} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:07 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd 1073741824" returned: 0 in 0.669s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:08 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd Sep 28 19:25:08 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (367fd354-84a8-4361-9023-a7f60ca127e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a027083-a994-4828-a783-fbf19f6c00ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a027083-a994-4828-a783-fbf19f6c00ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-743868409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fe169d-7b0c-410c-8424-a2d52672c2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:08Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3a6d48-241e-4b05-b160-43b06994ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3a6d48-241e-4b05-b160-43b06994ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dec3a3-a6ae-44bf-9907-5e646a253e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dec3a3-a6ae-44bf-9907-5e646a253e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18fe169d-7b0c-410c-8424-a2d52672c2af', 'volume_name': 'volume-18fe169d-7b0c-410c-8424-a2d52672c2af', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c60c835-9161-40b4-8da6-252a8bd17926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c60c835-9161-40b4-8da6-252a8bd17926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3602af9-d720-4aa9-ba2b-71bccf60a2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume 18fe169d-7b0c-410c-8424-a2d52672c2af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18fe169d-7b0c-410c-8424-a2d52672c2af', 'volume_size': 1} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:08 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd" returned: 0 in 0.377s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-143445168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6642426b-d6d2-4740-971f-8163430c4326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:05Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Creating volume 6642426b-d6d2-4740-971f-8163430c4326 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:08 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4357aa77-47ce-48ca-9c69-2de6a30ee4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa90d822-f6b4-4a46-a109-3ea3323cac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:08 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 1073741824 Sep 28 19:25:08 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Volume volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd (5e765f62-9f6d-4adb-a80c-c17ab305d2fd): created successfully Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa90d822-f6b4-4a46-a109-3ea3323cac21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Flow 'volume_create_manager' (eac6a7f5-b7cd-4a2b-9ef3-cb45d07ce409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ce1f8d28-ec6f-4b4e-b586-f13a1ccec563 tempest-CreateVolumesFromImageTest-1321262300 None] Created volume successfully. Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (506b25ba-8016-46ec-82d3-7a86414cea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:09 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bb9aa8-752f-4ef8-8d3e-d64b16597fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 1073741824" returned: 0 in 0.660s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bb9aa8-752f-4ef8-8d3e-d64b16597fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-534618745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9197912-6827-4f07-b6ef-26136a3f38bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:09Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b97980d-199e-4430-b19d-f1f7d778bb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b97980d-199e-4430-b19d-f1f7d778bb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339af8d3-d0fd-4f27-a546-fa5e1a0cd0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339af8d3-d0fd-4f27-a546-fa5e1a0cd0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9197912-6827-4f07-b6ef-26136a3f38bf', 'volume_name': 'volume-b9197912-6827-4f07-b6ef-26136a3f38bf', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96db4db-37c4-4b86-bf3f-273f109c4b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96db4db-37c4-4b86-bf3f-273f109c4b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7866cb49-df07-4824-b05a-795767eed395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume b9197912-6827-4f07-b6ef-26136a3f38bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9197912-6827-4f07-b6ef-26136a3f38bf', 'volume_size': 1} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Flow 'volume_create_manager' (f68db70c-4c51-4989-8055-9df38d31a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54f92c6-cafc-4174-81d2-7169a839ade5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54f92c6-cafc-4174-81d2-7169a839ade5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f8a9e4-290a-4719-81c5-2ee39db89e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4fd0d1568c4766b87276fcd81a4af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:09Z,use_quota=True,user_id='8c98da7c66b54d0d8d40672a1187c01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce68a107-0b92-4ee9-bc2f-d14ea9ac75f2),volume_type_id=ce68a107-0b92-4ee9-bc2f-d14ea9ac75f2)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356ec646-85fc-4d97-8dbd-c63c50ea1d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356ec646-85fc-4d97-8dbd-c63c50ea1d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2249c76-7b92-4133-b596-466f559779ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:09 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 Sep 28 19:25:09 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (6ea71bab-a00a-4d95-b5bb-55c9b14971dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48a42fe-3079-4ccf-a6b0-e28090978e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48a42fe-3079-4ccf-a6b0-e28090978e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-435488994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ba7716-439d-40b9-bf4c-a630a4e3aa5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:09Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f67bbd-69a9-4643-9a4a-cf65cb6cabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f67bbd-69a9-4643-9a4a-cf65cb6cabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17189f4-b47d-4f06-a164-1470b708ab6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17189f4-b47d-4f06-a164-1470b708ab6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ba7716-439d-40b9-bf4c-a630a4e3aa5c', 'volume_name': 'volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b97c31-5c0d-49f2-a5d4-630fbab0e8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b97c31-5c0d-49f2-a5d4-630fbab0e8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f063ef9e-467e-4d3a-a1b1-fa9f296dc0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume c2ba7716-439d-40b9-bf4c-a630a4e3aa5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c', 'volume_size': 1} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:09 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326" returned: 0 in 0.381s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.800s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-984684274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0a7122-1027-4684-bef3-ef51a1346c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8f2e8297a149dd83ed6ef8ab549747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:05Z,use_quota=True,user_id='fe228d340d7640b6abfc33e58c166398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Creating volume ce0a7122-1027-4684-bef3-ef51a1346c4b {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:09 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:09 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b 1073741824 Sep 28 19:25:09 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b536deaa-689a-4df1-9ad1-b356d6f7f617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6642426b-d6d2-4740-971f-8163430c4326', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd88f31a-4fc1-44ad-836a-28adfd2d2f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Volume volume-6642426b-d6d2-4740-971f-8163430c4326 (6642426b-d6d2-4740-971f-8163430c4326): created successfully Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd88f31a-4fc1-44ad-836a-28adfd2d2f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (5eacb8eb-d8a6-435a-81c8-b58a37ac2ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (3f85e35d-80b7-4f89-b88f-c8904a3e7faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb1459f-0186-45b1-bb50-7a08c27da8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-48e1c3f9-afa6-4e7f-8be7-3f17566673a3 tempest-ProjectMemberTests-2079916226 None] Created volume successfully. Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2249c76-7b92-4133-b596-466f559779ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '37f8a9e4-290a-4719-81c5-2ee39db89e00', 'volume_name': 'volume-37f8a9e4-290a-4719-81c5-2ee39db89e00', 'volume_size': 1, 'image_id': 'c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3d6e899129ed9fb85a5b8e1b383a939', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c4fd0d1568c4766b87276fcd81a4af3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5125268949737e9943c95676a2c65c5665a8612dd3873b40d2347bd0810e522e6c93cd022056c2ff1ab7cbcee43efd6853ae495c3fe6519552185bd836673590', 'id': 'c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'created_at': datetime.datetime(2026, 9, 28, 17, 25, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 25, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abf3ab9-22b9-4549-9115-03bca47eb8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abf3ab9-22b9-4549-9115-03bca47eb8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cab657-8dbe-4b82-b62b-c7521a927a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Volume 37f8a9e4-290a-4719-81c5-2ee39db89e00: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-37f8a9e4-290a-4719-81c5-2ee39db89e00', 'volume_size': 1, 'image_id': 'c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3d6e899129ed9fb85a5b8e1b383a939', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c4fd0d1568c4766b87276fcd81a4af3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5125268949737e9943c95676a2c65c5665a8612dd3873b40d2347bd0810e522e6c93cd022056c2ff1ab7cbcee43efd6853ae495c3fe6519552185bd836673590', 'id': 'c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'created_at': datetime.datetime(2026, 9, 28, 17, 25, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 25, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Trying to clone 37f8a9e4-290a-4719-81c5-2ee39db89e00 from image c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb1459f-0186-45b1-bb50-7a08c27da8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138309012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b12ec3-921a-4446-83d0-bf5fffac18d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:10Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261c7036-4a4e-4800-af00-6ede3640f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261c7036-4a4e-4800-af00-6ede3640f85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7831ec-3a7e-43e8-9eeb-9da924377a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7831ec-3a7e-43e8-9eeb-9da924377a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b12ec3-921a-4446-83d0-bf5fffac18d7', 'volume_name': 'volume-70b12ec3-921a-4446-83d0-bf5fffac18d7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d7d082-e9e1-49c4-b432-28a163757ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d7d082-e9e1-49c4-b432-28a163757ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd71e16-5da4-4a74-8ebc-a38c20f4612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume 70b12ec3-921a-4446-83d0-bf5fffac18d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b12ec3-921a-4446-83d0-bf5fffac18d7', 'volume_size': 1} Sep 28 19:25:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 19:25:10 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Image download 0.00 MB at 0.00 MB/s Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8363e4c4-0a6f-493e-a910-62feedf2e997]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:10 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD Sep 28 19:25:10 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:10 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b 1073741824" returned: 0 in 0.564s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:10 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b Sep 28 19:25:10 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:10 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:10 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.591s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-419323971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318dae98-567b-4313-bd66-9277ab27f065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8f2e8297a149dd83ed6ef8ab549747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:06Z,use_quota=True,user_id='fe228d340d7640b6abfc33e58c166398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Creating volume 318dae98-567b-4313-bd66-9277ab27f065 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:10 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a1c02d-a9bf-4871-b4be-9b964cffbff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce0a7122-1027-4684-bef3-ef51a1346c4b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:10 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD Sep 28 19:25:10 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065 1073741824 Sep 28 19:25:10 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:10 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81edc99e-55c4-48ae-b67c-7bf12a363c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Volume volume-ce0a7122-1027-4684-bef3-ef51a1346c4b (ce0a7122-1027-4684-bef3-ef51a1346c4b): created successfully Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81edc99e-55c4-48ae-b67c-7bf12a363c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Flow 'volume_create_manager' (27e36929-4e41-49ad-be66-66cb71713441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a8814806-e60f-4a35-b755-0ed11f8b0eef tempest-CreateVolumesFromImageTest-1321262300 None] Created volume successfully. Sep 28 19:25:10 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD" returned: 1 in 0.467s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:25:10 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Temporary image c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4 is fetched for user 8c98da7c66b54d0d8d40672a1187c01d. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae3db8-5a67-4434-bccb-983c214a7a87]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:11 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD Sep 28 19:25:11 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:11 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065 1073741824" returned: 0 in 0.642s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:11 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065 Sep 28 19:25:11 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:11 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD" returned: 0 in 0.417s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:11 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:11 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD Sep 28 19:25:11 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.793s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947505157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c89012-c715-4499-8408-56ef657aed50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:08Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Creating volume a7c89012-c715-4499-8408-56ef657aed50 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:11 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:11 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50 1073741824 Sep 28 19:25:11 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f48c249-2605-418c-ac4f-26d264b8feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318dae98-567b-4313-bd66-9277ab27f065', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba73635e-a07b-4393-af34-4e902607d097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Volume volume-318dae98-567b-4313-bd66-9277ab27f065 (318dae98-567b-4313-bd66-9277ab27f065): created successfully Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba73635e-a07b-4393-af34-4e902607d097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Flow 'volume_create_manager' (99bfca89-99c4-4d3b-be8c-fac2468e100c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6001543c-9d34-498b-b243-93460948c1c5 tempest-CreateVolumesFromImageTest-1321262300 None] Created volume successfully. Sep 28 19:25:11 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD" returned: 1 in 0.411s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:25:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "cinder-318dae98-567b-4313-bd66-9277ab27f065-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-318dae98-567b-4313-bd66-9277ab27f065-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "cinder-quobyte-318dae98-567b-4313-bd66-9277ab27f065" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-quobyte-318dae98-567b-4313-bd66-9277ab27f065" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9f4005-adfe-416e-8509-4d3bea1f727d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:12 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50 1073741824" returned: 0 in 0.599s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:12 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065 Sep 28 19:25:12 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:12 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50 Sep 28 19:25:12 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:12 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50" returned: 0 in 0.301s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:12 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.218s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-743868409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fe169d-7b0c-410c-8424-a2d52672c2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:08Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Creating volume 18fe169d-7b0c-410c-8424-a2d52672c2af {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:12 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065" returned: 0 in 0.451s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:12 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af 1073741824 Sep 28 19:25:12 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb3c47b-4b9f-42b0-b2bb-e768a08009b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c89012-c715-4499-8408-56ef657aed50', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdec20e9-54ed-4053-b82c-bb160ab1ee0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:12 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065 Sep 28 19:25:12 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume volume-a7c89012-c715-4499-8408-56ef657aed50 (a7c89012-c715-4499-8408-56ef657aed50): created successfully Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdec20e9-54ed-4053-b82c-bb160ab1ee0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (f66141d7-d3df-44c2-b9ea-d5f5c1d5f2e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ee2f4b05-f5aa-414b-9aea-287f2b7a38d0 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created volume successfully. Sep 28 19:25:12 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-318dae98-567b-4313-bd66-9277ab27f065" returned: 0 in 0.280s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-quobyte-318dae98-567b-4313-bd66-9277ab27f065" released by "delete_volume" :: held 0.783s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:12 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Created reservations ['04ebc167-f1bd-427c-a961-9f829418e63a', '800618d3-9205-491e-aaad-24771dd35eb2', '0536cfd5-b678-4dad-8a20-305cabd87f0e', 'ddde3036-d671-4672-906d-a4bd80d43394'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:13 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:13 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:13 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af 1073741824" returned: 0 in 0.623s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "cinder-ce0a7122-1027-4684-bef3-ef51a1346c4b-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-ce0a7122-1027-4684-bef3-ef51a1346c4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:13 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af Sep 28 19:25:13 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "cinder-quobyte-ce0a7122-1027-4684-bef3-ef51a1346c4b" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-quobyte-ce0a7122-1027-4684-bef3-ef51a1346c4b" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:13 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae7ff0b-2870-4b8b-ab00-bb821e9cbe74]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Deleted volume successfully. Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a136bd1-35b9-4734-8cfc-b9e88ac2bf41 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-318dae98-567b-4313-bd66-9277ab27f065-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:13 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b Sep 28 19:25:13 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:13 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af" returned: 0 in 0.383s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.494s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-534618745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9197912-6827-4f07-b6ef-26136a3f38bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:09Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Creating volume b9197912-6827-4f07-b6ef-26136a3f38bf {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:13 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3602af9-d720-4aa9-ba2b-71bccf60a2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18fe169d-7b0c-410c-8424-a2d52672c2af', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:13 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf 1073741824 Sep 28 19:25:13 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1767d704-7a73-4ee7-b25b-e3ab3966574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume volume-18fe169d-7b0c-410c-8424-a2d52672c2af (18fe169d-7b0c-410c-8424-a2d52672c2af): created successfully Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1767d704-7a73-4ee7-b25b-e3ab3966574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (367fd354-84a8-4361-9023-a7f60ca127e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-687e3f93-e448-4d0c-a9d9-7fb4e20cb29d tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created volume successfully. Sep 28 19:25:13 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b" returned: 0 in 0.467s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:13 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b Sep 28 19:25:13 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:14 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ce0a7122-1027-4684-bef3-ef51a1346c4b" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-quobyte-ce0a7122-1027-4684-bef3-ef51a1346c4b" released by "delete_volume" :: held 0.856s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:14 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf 1073741824" returned: 0 in 0.597s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Created reservations ['2e0f0a64-7f23-4362-b1f6-bff143249d66', 'd745fb74-6e0a-46f7-9174-427986477525', '2f03aa11-10a8-4297-9fdb-c74773e35cec', '78304ec3-359e-4084-893a-96c408088f53'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:14 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf Sep 28 19:25:14 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:14 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:14 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "cinder-5e765f62-9f6d-4adb-a80c-c17ab305d2fd-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-5e765f62-9f6d-4adb-a80c-c17ab305d2fd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "cinder-quobyte-5e765f62-9f6d-4adb-a80c-c17ab305d2fd" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-quobyte-5e765f62-9f6d-4adb-a80c-c17ab305d2fd" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66427fd-bc38-4cd0-8322-f86a2270aaaf]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:14 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf" returned: 0 in 0.327s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.240s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-435488994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ba7716-439d-40b9-bf4c-a630a4e3aa5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:09Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Creating volume c2ba7716-439d-40b9-bf4c-a630a4e3aa5c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:14 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7866cb49-df07-4824-b05a-795767eed395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9197912-6827-4f07-b6ef-26136a3f38bf', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2306f464-7ed2-406b-90af-cbdc7f74789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:14 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c 1073741824 Sep 28 19:25:14 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume volume-b9197912-6827-4f07-b6ef-26136a3f38bf (b9197912-6827-4f07-b6ef-26136a3f38bf): created successfully Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2306f464-7ed2-406b-90af-cbdc7f74789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (506b25ba-8016-46ec-82d3-7a86414cea45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:14 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ff38902f-9600-4ef9-9208-c56b03714138 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created volume successfully. Sep 28 19:25:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Deleted volume successfully. Sep 28 19:25:14 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd Sep 28 19:25:14 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5a4485c-7a51-4dc0-8d97-aaa1934a83b0 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-ce0a7122-1027-4684-bef3-ef51a1346c4b-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:15 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd" returned: 0 in 0.449s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:15 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd Sep 28 19:25:15 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:15 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c 1073741824" returned: 0 in 0.567s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:15 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c Sep 28 19:25:15 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:15 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5e765f62-9f6d-4adb-a80c-c17ab305d2fd" returned: 0 in 0.292s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-quobyte-5e765f62-9f6d-4adb-a80c-c17ab305d2fd" released by "delete_volume" :: held 0.795s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Created reservations ['c2e55609-691a-4a84-a441-c6746bc8de35', '7ce48754-37bf-4f8b-9248-713e6d710091', '7915d76e-def9-406a-a791-914c06b70974', '6938d6cb-bf19-43be-85bb-fdd275d7342f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:15 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:15 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:15 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c" returned: 0 in 0.273s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.586s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138309012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b12ec3-921a-4446-83d0-bf5fffac18d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f729ae2fcc074ee89c6d8de776be1ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:10Z,use_quota=True,user_id='0af190aaaffe4e4cb48d3bdede6185f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Creating volume 70b12ec3-921a-4446-83d0-bf5fffac18d7 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:15 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f063ef9e-467e-4d3a-a1b1-fa9f296dc0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdfedf2-7300-4bc3-9a88-563a584b61fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:15 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7 1073741824 Sep 28 19:25:15 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c (c2ba7716-439d-40b9-bf4c-a630a4e3aa5c): created successfully Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdfedf2-7300-4bc3-9a88-563a584b61fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (6ea71bab-a00a-4d95-b5bb-55c9b14971dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dcb083df-9c2e-453f-994d-69afc7d21071 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created volume successfully. Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "cinder-b0b9c790-58c1-46a6-82d4-7f78920a44f9-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-b0b9c790-58c1-46a6-82d4-7f78920a44f9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "cinder-quobyte-b0b9c790-58c1-46a6-82d4-7f78920a44f9" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-quobyte-b0b9c790-58c1-46a6-82d4-7f78920a44f9" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:15 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Deleted volume successfully. Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8367ed-6f81-43b7-8fd6-c9ce3fe54145]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-61bd760d-790e-4c7b-b24b-9bafa90850c1 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-5e765f62-9f6d-4adb-a80c-c17ab305d2fd-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:15 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9 Sep 28 19:25:15 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:16 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7 1073741824" returned: 0 in 0.507s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:16 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7 Sep 28 19:25:16 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:16 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:16 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9 Sep 28 19:25:16 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:16 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.059s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd71e16-5da4-4a74-8ebc-a38c20f4612c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b12ec3-921a-4446-83d0-bf5fffac18d7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094d2e19-5a93-4f42-9c23-d0373343af64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Creating offline snapshot d4552738-b64a-4dab-ba4d-7618b155de1d of volume 6642426b-d6d2-4740-971f-8163430c4326 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:25:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Volume volume-70b12ec3-921a-4446-83d0-bf5fffac18d7 (70b12ec3-921a-4446-83d0-bf5fffac18d7): created successfully Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094d2e19-5a93-4f42-9c23-d0373343af64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Flow 'volume_create_manager' (3f85e35d-80b7-4f89-b88f-c8904a3e7faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e589ad76-4925-4850-919d-fe0289d3b74a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4e991930-6c8d-474c-bbd8-8e01fa568a58 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created volume successfully. Sep 28 19:25:16 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b0b9c790-58c1-46a6-82d4-7f78920a44f9" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-quobyte-b0b9c790-58c1-46a6-82d4-7f78920a44f9" released by "delete_volume" :: held 0.810s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:16 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 Sep 28 19:25:16 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Created reservations ['124fce5b-6c4a-4d6e-ba1b-a976920d4745', 'b3ff0245-f1b9-45f6-b952-f8fdbd310cc5', '4faee811-1d03-4fa4-b66f-e625603a69a5', '494708e1-eb9b-4d8f-8be6-9c8f53b07e7c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:16 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:16 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "cinder-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:16 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326" returned: 0 in 0.499s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:16 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d 1G Sep 28 19:25:16 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "cinder-quobyte-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-quobyte-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e240ee-69ee-463b-bf46-394e2905b8de]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:17 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.326s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Deleted volume successfully. Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7cebb6b-c113-4989-a470-d40e2433b9e8 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-b0b9c790-58c1-46a6-82d4-7f78920a44f9-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:17 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 Sep 28 19:25:17 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:17 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d 1G" returned: 0 in 0.515s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6642426b-d6d2-4740-971f-8163430c4326 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:17 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6642426b-d6d2-4740-971f-8163430c4326 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d Sep 28 19:25:17 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:17 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4" returned: 0 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-70b12ec3-921a-4446-83d0-bf5fffac18d7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:17 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4 Sep 28 19:25:17 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-70b12ec3-921a-4446-83d0-bf5fffac18d7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-quobyte-70b12ec3-921a-4446-83d0-bf5fffac18d7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-70b12ec3-921a-4446-83d0-bf5fffac18d7" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b6d17f-ad72-442c-b712-bfc7baa309b5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:17 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7 Sep 28 19:25:17 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:17 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4" returned: 0 in 0.346s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:17 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6642426b-d6d2-4740-971f-8163430c4326 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d" returned: 0 in 0.416s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:17 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d is being set with open permissions: ugo+rw Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-quobyte-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4" released by "delete_volume" :: held 0.866s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:17 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d Sep 28 19:25:17 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:17 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Created reservations ['88cd87c1-a685-4ed1-a183-673c4e7f5328', '3f33213a-8987-42c5-b47e-444d7372a87b', 'cfe83122-547e-4568-ad55-d704c957be7e', '6dd24aa1-a076-44c2-981a-85dd0f02e07e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:18 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7" returned: 0 in 0.449s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:18 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:18 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:18 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7 Sep 28 19:25:18 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:18 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:18 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.info Sep 28 19:25:18 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:18 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Deleted volume successfully. Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ae2f8068-6292-4b50-9f3f-3fdc61fc3322 tempest-CreateVolumesFromImageTest-1321262300 None] Lock "cinder-5036ef27-2eea-4d5f-892b-d0a2ebc5eeb4-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:18 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-70b12ec3-921a-4446-83d0-bf5fffac18d7" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-70b12ec3-921a-4446-83d0-bf5fffac18d7" released by "delete_volume" :: held 0.855s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created reservations ['2b64646d-9fcf-4c38-8105-57f4fdd48188', '2373dbe5-a83c-4768-bac4-ce4b8bcb91c0', 'a1e57060-bfd1-47d9-9f6a-eb0dc71d69a0', '44e4c559-79d9-4793-80a1-c5507ddbff7e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:18 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.info" returned: 0 in 0.384s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:18 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.info is being set with open permissions: ugo+rw Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:18 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.info Sep 28 19:25:18 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:18 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:18 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-quobyte-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ee104-366a-4583-aab0-7f51b6fb2428]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:18 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.info" returned: 0 in 0.372s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.194s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f8a9e4-290a-4719-81c5-2ee39db89e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4fd0d1568c4766b87276fcd81a4af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:09Z,use_quota=True,user_id='8c98da7c66b54d0d8d40672a1187c01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce68a107-0b92-4ee9-bc2f-d14ea9ac75f2),volume_type_id=ce68a107-0b92-4ee9-bc2f-d14ea9ac75f2)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Creating volume 37f8a9e4-290a-4719-81c5-2ee39db89e00 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:19 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:19 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:19 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 1073741824 Sep 28 19:25:19 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.461s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:19 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:19 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Deleted volume successfully. Sep 28 19:25:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7c64b25e-a7b5-4bfd-a64f-31a34d21b400 tempest-ProjectMemberTests-2079916226 None] Create snapshot completed successfully Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5014dfd3-fe83-41f6-be92-5076c5e961b7 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-70b12ec3-921a-4446-83d0-bf5fffac18d7-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:19 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c" returned: 0 in 0.545s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:19 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c Sep 28 19:25:19 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:19 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 1073741824" returned: 0 in 0.639s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-d4552738-b64a-4dab-ba4d-7618b155de1d-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-d4552738-b64a-4dab-ba4d-7618b155de1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-6642426b-d6d2-4740-971f-8163430c4326" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:19 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 Sep 28 19:25:19 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-6642426b-d6d2-4740-971f-8163430c4326" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-d4552738-b64a-4dab-ba4d-7618b155de1d" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-d4552738-b64a-4dab-ba4d-7618b155de1d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Deleting offline snapshot d4552738-b64a-4dab-ba4d-7618b155de1d of volume 6642426b-d6d2-4740-971f-8163430c4326 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] snapshot_file for this snap is: volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720a9d1-00f9-478b-ac6d-7b45dc381ccd]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:19 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c" returned: 0 in 0.436s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c" released by "delete_volume" :: held 1.061s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created reservations ['4b09dece-bd24-41f8-bf5c-dd1e4801a02d', 'bc958d05-c6dc-43c6-abcd-4def215c8aa3', '9e932261-00c5-4150-a8ae-cf341ddca91a', '023d1845-dd76-46c7-a846-966c98841889'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:20 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d Sep 28 19:25:20 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:20 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00" returned: 0 in 0.452s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:20 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:20 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Attempting download of c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'metadata': {}}])) to volume 37f8a9e4-290a-4719-81c5-2ee39db89e00. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf84541-ec88-41d0-bb2a-84b7dd8c7283]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_ikw5hi0z {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:20 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d" returned: 0 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6642426b-d6d2-4740-971f-8163430c4326(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4162de8a-63f9-4c26-a6ba-be9bb826587f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:20 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_ikw5hi0z Sep 28 19:25:20 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:20 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.380s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Deleted volume successfully. Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a89c5a28-9941-4f24-bdb6-743fc7486a3e tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-c2ba7716-439d-40b9-bf4c-a630a4e3aa5c-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:20 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 Sep 28 19:25:20 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:20 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_ikw5hi0z" returned: 0 in 0.465s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_ikw5hi0z {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:20 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_ikw5hi0z Sep 28 19:25:20 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:20 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326" returned: 0 in 0.533s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:21 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d Sep 28 19:25:21 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-b9197912-6827-4f07-b6ef-26136a3f38bf-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-b9197912-6827-4f07-b6ef-26136a3f38bf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:21 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_ikw5hi0z" returned: 1 in 0.439s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_ikw5hi0z' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7538af50-0bf5-4bef-9962-812c91466681]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-quobyte-b9197912-6827-4f07-b6ef-26136a3f38bf" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-b9197912-6827-4f07-b6ef-26136a3f38bf" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d45185e-08c2-4132-bb14-e932aabed2a9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:21 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD Sep 28 19:25:21 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:21 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf Sep 28 19:25:21 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:21 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d" returned: 0 in 0.616s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:21 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:21 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:21 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:21 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD Sep 28 19:25:21 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:22 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326.d4552738-b64a-4dab-ba4d-7618b155de1d" returned: 0 in 0.387s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:22 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf" returned: 0 in 0.730s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-d4552738-b64a-4dab-ba4d-7618b155de1d" released by "_delete_snapshot" :: held 2.205s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-6642426b-d6d2-4740-971f-8163430c4326" released by "delete_snapshot" :: held 2.245s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:22 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf Sep 28 19:25:22 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Created reservations ['00ca74a1-bb6b-4135-95c0-7c44e10d695c', '8c8be582-fe3c-4527-a1ef-09a3ce52ad49', 'aecd9988-b5f8-43c5-be7e-c2f57f347acd', '371b5c9f-8fd8-450f-bc68-a11ec89d825f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:22 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD" returned: 1 in 0.485s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4 was raw, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:22 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 Sep 28 19:25:22 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Delete snapshot completed successfully. Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff0bff77-7a1f-4c01-8cb1-c997d904c202 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-d4552738-b64a-4dab-ba4d-7618b155de1d-delete_snapshot" released by "delete_snapshot" :: held 2.536s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:22 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-b9197912-6827-4f07-b6ef-26136a3f38bf" returned: 0 in 0.425s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-b9197912-6827-4f07-b6ef-26136a3f38bf" released by "delete_volume" :: held 1.230s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created reservations ['a7e31a4b-4391-4232-8fb3-814b45c17d98', '4ad797dd-5ccd-4371-ade7-8d2e0846d3fa', 'e0b377ec-9642-44f7-82b6-2c1657421871', '4c8dea3a-8848-4dfe-b275-94ec777bbe03'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:22 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:22 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:22 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00" returned: 0 in 0.776s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4_jj4crj12devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:25:22 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 19:25:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:23 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:23 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 1G Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:23 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Deleted volume successfully. Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-6642426b-d6d2-4740-971f-8163430c4326-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fccefa9e-7f3c-4e89-9492-7e30c792881b tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-b9197912-6827-4f07-b6ef-26136a3f38bf-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-6642426b-d6d2-4740-971f-8163430c4326-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-6642426b-d6d2-4740-971f-8163430c4326" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-6642426b-d6d2-4740-971f-8163430c4326" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[15852437-6b66-4ae1-9ed0-ae340a757fae]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:23 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 Sep 28 19:25:23 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:23 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-18fe169d-7b0c-410c-8424-a2d52672c2af-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 1G" returned: 0 in 0.519s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Downloaded image c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'metadata': {}}])) to volume 37f8a9e4-290a-4719-81c5-2ee39db89e00 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Temporary image c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4 for user 8c98da7c66b54d0d8d40672a1187c01d is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Marking volume 37f8a9e4-290a-4719-81c5-2ee39db89e00 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-18fe169d-7b0c-410c-8424-a2d52672c2af-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Copying metadata from image c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4 to 37f8a9e4-290a-4719-81c5-2ee39db89e00. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Creating volume glance metadata for volume 37f8a9e4-290a-4719-81c5-2ee39db89e00 backed by image c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e3d6e899129ed9fb85a5b8e1b383a939', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-quobyte-18fe169d-7b0c-410c-8424-a2d52672c2af" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-18fe169d-7b0c-410c-8424-a2d52672c2af" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Flow 'volume_create_manager' (8ab89c5b-a53a-49f0-b5bb-6a4101153938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9970ec20-3f21-47fe-ab13-eaa0592b860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53457fa-cd36-452f-a857-ebea83890975]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:23 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326" returned: 0 in 0.549s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9970ec20-3f21-47fe-ab13-eaa0592b860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489791493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1035237e-c238-406e-9288-914383a5cae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fac010de56a412b937dbc6f377243d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:24Z,use_quota=True,user_id='15fdc29150c84681a8c0bf4c902e42eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:23 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326 Sep 28 19:25:23 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad44b1e-713e-4a91-aaa1-e5a916bed12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad44b1e-713e-4a91-aaa1-e5a916bed12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4bfaa2-eb34-4077-a20b-9dd474997000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4bfaa2-eb34-4077-a20b-9dd474997000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1035237e-c238-406e-9288-914383a5cae2', 'volume_name': 'volume-1035237e-c238-406e-9288-914383a5cae2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0005778-d675-45e0-ade5-5f4a36b444d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0005778-d675-45e0-ade5-5f4a36b444d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04a2077-65cf-49e4-8179-22d14dad6aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Volume 1035237e-c238-406e-9288-914383a5cae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1035237e-c238-406e-9288-914383a5cae2', 'volume_size': 1} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489791493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1035237e-c238-406e-9288-914383a5cae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fac010de56a412b937dbc6f377243d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:24Z,use_quota=True,user_id='15fdc29150c84681a8c0bf4c902e42eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Creating volume 1035237e-c238-406e-9288-914383a5cae2 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:23 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:23 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af Sep 28 19:25:23 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:23 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2 1073741824 Sep 28 19:25:23 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cab657-8dbe-4b82-b62b-c7521a927a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f8a9e4-290a-4719-81c5-2ee39db89e00', 'volume_size': 1, 'image_id': 'c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3d6e899129ed9fb85a5b8e1b383a939', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c4fd0d1568c4766b87276fcd81a4af3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5125268949737e9943c95676a2c65c5665a8612dd3873b40d2347bd0810e522e6c93cd022056c2ff1ab7cbcee43efd6853ae495c3fe6519552185bd836673590', 'id': 'c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4', 'created_at': datetime.datetime(2026, 9, 28, 17, 25, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 25, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9cb8a00-bf08-4048-b8e5-55ba5e5b49e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd4eb9e-9acd-4d11-9df6-8d4812f1ccf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Volume volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 (37f8a9e4-290a-4719-81c5-2ee39db89e00): created successfully Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd4eb9e-9acd-4d11-9df6-8d4812f1ccf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Flow 'volume_create_manager' (f68db70c-4c51-4989-8055-9df38d31a67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fcc73725-c537-433b-b93a-a5dc14ae5e4c tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Created volume successfully. Sep 28 19:25:24 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6642426b-d6d2-4740-971f-8163430c4326" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-6642426b-d6d2-4740-971f-8163430c4326" released by "delete_volume" :: held 0.972s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:24 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Created reservations ['53211e96-e383-437b-85c8-7a3b4be09b69', '60f19dc6-4929-49e1-890d-bd89083d8f0f', '297e6d96-7941-44f6-946a-839ce30f875e', '94ff6165-d63b-4ae8-83c6-bd3867015895'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:24 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af Sep 28 19:25:24 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:24 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:24 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:24 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2 1073741824" returned: 0 in 0.640s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:24 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-18fe169d-7b0c-410c-8424-a2d52672c2af" returned: 0 in 0.394s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:24 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2 Sep 28 19:25:24 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-18fe169d-7b0c-410c-8424-a2d52672c2af" released by "delete_volume" :: held 0.958s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:24 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.315s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Deleted volume successfully. Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdac65a-9ff4-4f2c-8ac0-79cf04642895 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-6642426b-d6d2-4740-971f-8163430c4326-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created reservations ['39278dcb-8a6d-4901-9d83-f763ce3f88d8', '7aa0489c-6cc0-447b-b97c-620389347ad3', 'a6b5673c-261c-42f7-bada-e46fd3feb56d', 'effff883-7e6d-4789-9afc-6dbb6851b2d9'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:24 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:24 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:24 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2" returned: 0 in 0.343s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04a2077-65cf-49e4-8179-22d14dad6aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1035237e-c238-406e-9288-914383a5cae2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa8882c-5757-4546-9b19-274eb7728afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:24 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Volume volume-1035237e-c238-406e-9288-914383a5cae2 (1035237e-c238-406e-9288-914383a5cae2): created successfully Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa8882c-5757-4546-9b19-274eb7728afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Flow 'volume_create_manager' (8ab89c5b-a53a-49f0-b5bb-6a4101153938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-995fb7ce-5776-4122-bed7-86c8f7b9605a tempest-ProjectReaderTests-1497888399 None] Created volume successfully. Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Acquiring lock "cinder-37f8a9e4-290a-4719-81c5-2ee39db89e00-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Lock "cinder-37f8a9e4-290a-4719-81c5-2ee39db89e00-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Acquiring lock "cinder-quobyte-37f8a9e4-290a-4719-81c5-2ee39db89e00" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Lock "cinder-quobyte-37f8a9e4-290a-4719-81c5-2ee39db89e00" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:25 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Deleted volume successfully. Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0315b8fe-c1f5-472b-b5d8-03638329de2b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c39ca690-43d3-4f10-96b0-6a7fd2a8cacb tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-18fe169d-7b0c-410c-8424-a2d52672c2af-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:25 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 Sep 28 19:25:25 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:25 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:25 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00 Sep 28 19:25:25 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-a7c89012-c715-4499-8408-56ef657aed50-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-a7c89012-c715-4499-8408-56ef657aed50-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Acquiring lock "cinder-1035237e-c238-406e-9288-914383a5cae2-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (d0c70ae8-7912-4973-bb73-1e4c5620b3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cdb181-377e-4dae-98ce-aba6cfe3da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:26 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cdb181-377e-4dae-98ce-aba6cfe3da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828924117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611ff7c9-44d4-42b1-bd71-196872efe420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:26Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827b9cef-a2d0-468a-98e4-a3c27acdd94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827b9cef-a2d0-468a-98e4-a3c27acdd94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba637dd1-1628-4c79-8f8e-40eee6a52589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba637dd1-1628-4c79-8f8e-40eee6a52589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '611ff7c9-44d4-42b1-bd71-196872efe420', 'volume_name': 'volume-611ff7c9-44d4-42b1-bd71-196872efe420', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15ff00f-a24a-424b-a434-59fd46c33543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15ff00f-a24a-424b-a434-59fd46c33543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3139bfa2-4e92-456c-8bac-1d017f9676ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:26 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Volume 611ff7c9-44d4-42b1-bd71-196872efe420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-611ff7c9-44d4-42b1-bd71-196872efe420', 'volume_size': 1} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828924117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611ff7c9-44d4-42b1-bd71-196872efe420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:26Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Creating volume 611ff7c9-44d4-42b1-bd71-196872efe420 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:26 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Lock "cinder-1035237e-c238-406e-9288-914383a5cae2-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-37f8a9e4-290a-4719-81c5-2ee39db89e00" returned: 0 in 0.520s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:26 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 1073741824 Sep 28 19:25:26 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-quobyte-a7c89012-c715-4499-8408-56ef657aed50" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Lock "cinder-quobyte-37f8a9e4-290a-4719-81c5-2ee39db89e00" released by "delete_volume" :: held 1.064s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-a7c89012-c715-4499-8408-56ef657aed50" acquired by "delete_volume" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Acquiring lock "cinder-quobyte-1035237e-c238-406e-9288-914383a5cae2" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ab0e1-7577-4ca3-bc9b-f212212e3457]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Lock "cinder-quobyte-1035237e-c238-406e-9288-914383a5cae2" acquired by "delete_volume" :: waited 0.040s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd0010-30df-4152-8758-047a4a48c92b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Created reservations ['88cb4bb7-694d-4030-ae09-a74b413c16dd', '81838340-0518-469e-ad2e-a88cc1a7240d', '50d09e47-6806-4469-ad3f-d28631ef854e', 'f365c73d-a8e3-4da5-b2e9-c91b4da726b6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:26 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50 Sep 28 19:25:26 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:26 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2 Sep 28 19:25:26 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:26 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:26 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:26 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 1073741824" returned: 0 in 0.644s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:26 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.361s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:26 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Deleted volume successfully. Sep 28 19:25:26 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50" returned: 0 in 0.619s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:26 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 Sep 28 19:25:26 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2" returned: 0 in 0.550s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:26 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50 Sep 28 19:25:26 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bafdb6b7-f507-4f21-880e-94db181fdf5a tempest-VolumeAndVolumeTypeFromImageTest-2037556522 None] Lock "cinder-37f8a9e4-290a-4719-81c5-2ee39db89e00-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:26 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2 Sep 28 19:25:26 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:27 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420" returned: 0 in 0.328s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3139bfa2-4e92-456c-8bac-1d017f9676ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611ff7c9-44d4-42b1-bd71-196872efe420', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3e1e2e-756d-401e-a2c0-34b4f14d253b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Volume volume-611ff7c9-44d4-42b1-bd71-196872efe420 (611ff7c9-44d4-42b1-bd71-196872efe420): created successfully Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3e1e2e-756d-401e-a2c0-34b4f14d253b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:27 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (d0c70ae8-7912-4973-bb73-1e4c5620b3f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:27 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1035237e-c238-406e-9288-914383a5cae2" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a7c89012-c715-4499-8408-56ef657aed50" returned: 0 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-a7c89012-c715-4499-8408-56ef657aed50" released by "delete_volume" :: held 1.054s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Lock "cinder-quobyte-1035237e-c238-406e-9288-914383a5cae2" released by "delete_volume" :: held 0.981s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-378256ec-6fab-4178-8652-eef39549a84d tempest-ProjectMemberTests-2079916226 None] Created volume successfully. Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created reservations ['7ab1e36d-7d8a-45ca-8320-f6e282c2bd48', 'b213e318-81ac-4962-8fe4-8b6a53e9740b', '3c97ac58-4209-40ad-a410-56607c97d8ab', '90e2920b-5485-43d1-893a-18ef6b629cdd'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Created reservations ['b2642ab4-5e13-40f5-a1f9-ba4a0cac3431', 'd89480c0-bc22-490c-80d4-6c0a19d49b73', 'd0c252bc-b19e-4260-8649-903058d261ea', '82453a3c-6b4f-4d98-9c48-fa46e28de56d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:27 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:27 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:27 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:27 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:27 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.396s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:27 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:27 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Deleted volume successfully. Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.523s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Deleted volume successfully. Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59388ab3-d258-4ba0-98e5-74709ad96264 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-a7c89012-c715-4499-8408-56ef657aed50-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bf664c5-0ea9-4dcd-b0a6-26eb46ce11d8 tempest-ProjectReaderTests-1497888399 None] Lock "cinder-1035237e-c238-406e-9288-914383a5cae2-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-54a40dba-3240-4040-bc54-58a5810bbc58-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-54a40dba-3240-4040-bc54-58a5810bbc58-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "cinder-quobyte-54a40dba-3240-4040-bc54-58a5810bbc58" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-54a40dba-3240-4040-bc54-58a5810bbc58" acquired by "delete_volume" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b106eae-4ba7-4f3e-aee8-c2a657e280ed]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Flow 'volume_create_manager' (ffe410db-8c29-4cc5-91f6-ee4e1269673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d9ce5c-d0f4-4ce8-a5a5-4f41ce36de14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Creating offline snapshot 30e1c9fa-790c-48b3-8829-0ab65a879c81 of volume 611ff7c9-44d4-42b1-bd71-196872efe420 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d9ce5c-d0f4-4ce8-a5a5-4f41ce36de14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529720566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5075d80d-38b3-4abb-8f86-ab91b0a9f0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fac010de56a412b937dbc6f377243d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:28Z,use_quota=True,user_id='15fdc29150c84681a8c0bf4c902e42eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb476e6-f8b3-4246-a866-db36dba4d43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb476e6-f8b3-4246-a866-db36dba4d43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523b6faa-7b1b-460c-b0d4-e101e7887468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:28 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58 Sep 28 19:25:28 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523b6faa-7b1b-460c-b0d4-e101e7887468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5075d80d-38b3-4abb-8f86-ab91b0a9f0ed', 'volume_name': 'volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c4921c-6687-4992-8d75-41e37d48cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c4921c-6687-4992-8d75-41e37d48cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62412297-d7d9-42da-a59c-a10fa8ad3c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Volume 5075d80d-38b3-4abb-8f86-ab91b0a9f0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed', 'volume_size': 1} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9457ab30-2dae-4370-ba24-a95bc1d15947]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:28 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 Sep 28 19:25:28 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:29 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58" returned: 0 in 0.524s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:29 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58 Sep 28 19:25:29 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:29 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420" returned: 0 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:29 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 1G Sep 28 19:25:29 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:29 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-54a40dba-3240-4040-bc54-58a5810bbc58" returned: 0 in 0.322s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-quobyte-54a40dba-3240-4040-bc54-58a5810bbc58" released by "delete_volume" :: held 0.913s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Created reservations ['9846c157-f2a5-4a08-aebf-5115d1bde36b', '65fa959a-cac9-40ac-8628-33eda0b698ca', '44383dfb-d51c-4f6e-8d7b-e77e99919c83', 'f1a7b4b1-7d1d-42ac-9639-fc26331bc2d8'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:29 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:29 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:29 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 1G" returned: 0 in 0.678s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-611ff7c9-44d4-42b1-bd71-196872efe420 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:29 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.331s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:29 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-611ff7c9-44d4-42b1-bd71-196872efe420 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 Sep 28 19:25:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Deleted volume successfully. Sep 28 19:25:29 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8b689600-e5ee-4016-b4b2-d837e9774716 tempest-CreateVolumesFromSourceVolumeTest-1496376221 None] Lock "cinder-54a40dba-3240-4040-bc54-58a5810bbc58-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:30 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-611ff7c9-44d4-42b1-bd71-196872efe420 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:30 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 is being set with open permissions: ugo+rw Sep 28 19:25:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:30 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 Sep 28 19:25:30 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:30 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81" returned: 0 in 0.301s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:30 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.info Sep 28 19:25:30 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:30 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.info" returned: 0 in 0.357s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:30 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.info is being set with open permissions: ugo+rw Sep 28 19:25:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:31 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.info Sep 28 19:25:31 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:31 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.info" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.621s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529720566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5075d80d-38b3-4abb-8f86-ab91b0a9f0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fac010de56a412b937dbc6f377243d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:28Z,use_quota=True,user_id='15fdc29150c84681a8c0bf4c902e42eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Creating volume 5075d80d-38b3-4abb-8f86-ab91b0a9f0ed {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:31 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed 1073741824 Sep 28 19:25:31 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4ea61500-369f-4299-a246-e197f76617ba tempest-ProjectMemberTests-2079916226 None] Create snapshot completed successfully Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-30e1c9fa-790c-48b3-8829-0ab65a879c81-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Lock "cinder-30e1c9fa-790c-48b3-8829-0ab65a879c81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-611ff7c9-44d4-42b1-bd71-196872efe420" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-611ff7c9-44d4-42b1-bd71-196872efe420" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-30e1c9fa-790c-48b3-8829-0ab65a879c81" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-30e1c9fa-790c-48b3-8829-0ab65a879c81" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Deleting offline snapshot 30e1c9fa-790c-48b3-8829-0ab65a879c81 of volume 611ff7c9-44d4-42b1-bd71-196872efe420 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] snapshot_file for this snap is: volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d590d-48bf-48ca-83a2-863096e8ee03]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:31 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 Sep 28 19:25:31 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:32 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed 1073741824" returned: 0 in 0.752s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:32 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed Sep 28 19:25:32 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:32 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81" returned: 0 in 0.568s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-611ff7c9-44d4-42b1-bd71-196872efe420(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c874417-f509-4726-aea1-46e2350a9899]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:32 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 Sep 28 19:25:32 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:32 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed" returned: 0 in 0.409s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62412297-d7d9-42da-a59c-a10fa8ad3c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d87ba3-d5b8-4b11-b4bc-14016a679c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Volume volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed (5075d80d-38b3-4abb-8f86-ab91b0a9f0ed): created successfully Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d87ba3-d5b8-4b11-b4bc-14016a679c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Flow 'volume_create_manager' (ffe410db-8c29-4cc5-91f6-ee4e1269673a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8db09af2-1971-4119-b527-666c39c8dd93 tempest-ProjectReaderTests-1497888399 None] Created volume successfully. Sep 28 19:25:32 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420" returned: 0 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:32 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 Sep 28 19:25:32 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:33 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81" returned: 0 in 0.444s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:33 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81 Sep 28 19:25:33 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:33 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420.30e1c9fa-790c-48b3-8829-0ab65a879c81" returned: 0 in 0.336s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-30e1c9fa-790c-48b3-8829-0ab65a879c81" released by "_delete_snapshot" :: held 2.054s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-611ff7c9-44d4-42b1-bd71-196872efe420" released by "delete_snapshot" :: held 2.083s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:33 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Created reservations ['4a1dd760-3296-4e07-a517-cd4d0242c3f8', 'ecdc3d63-a8dd-47a6-87e5-5a5cf8ee4ea7', '435ead31-1a36-41af-b7b4-9d6765a62f7d', '07e1c21c-74dc-4c76-81f1-8d75a8f8bc75'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Acquiring lock "cinder-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Lock "cinder-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Delete snapshot completed successfully. Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96e6ad9c-275a-4a74-8963-b72ad34c5c2d tempest-ProjectMemberTests-2079916226 None] Lock "cinder-30e1c9fa-790c-48b3-8829-0ab65a879c81-delete_snapshot" released by "delete_snapshot" :: held 2.354s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (fc8cca81-a9da-4945-89f2-a9741482dd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bca843-b02e-47d8-9a65-b5f6216b087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Acquiring lock "cinder-quobyte-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bca843-b02e-47d8-9a65-b5f6216b087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-511971602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8a2741-7594-482f-8e66-fcdfe66fa1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:34Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532ba5a7-bcf6-419c-a0d7-7113420b3f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532ba5a7-bcf6-419c-a0d7-7113420b3f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbebdf0-76ef-4ef6-8a45-d4c8dae15aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbebdf0-76ef-4ef6-8a45-d4c8dae15aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8a2741-7594-482f-8e66-fcdfe66fa1fa', 'volume_name': 'volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcd0d40-8b18-4cb5-b021-c0a278d0c679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcd0d40-8b18-4cb5-b021-c0a278d0c679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cc88b8-4047-4d56-a343-ce21a7304eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:34 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume 9e8a2741-7594-482f-8e66-fcdfe66fa1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa', 'volume_size': 1} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-511971602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8a2741-7594-482f-8e66-fcdfe66fa1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:34Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Creating volume 9e8a2741-7594-482f-8e66-fcdfe66fa1fa {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:34 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Lock "cinder-quobyte-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed" acquired by "delete_volume" :: waited 0.094s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:34 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa 1073741824 Sep 28 19:25:34 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d972e5d5-a0c9-48f2-847d-7bd7a1bffeb8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:34 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed Sep 28 19:25:34 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:34 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed" returned: 0 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:34 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:34 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:34 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed Sep 28 19:25:34 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:34 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa 1073741824" returned: 0 in 0.625s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Flow 'volume_create_manager' (38ff01cf-8e8c-40b6-9d89-8fe615ad9d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d21e763-5f1f-4b49-a831-eb145511bbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d21e763-5f1f-4b49-a831-eb145511bbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1834201062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089896da-c43f-488a-b9f7-51b96777bc4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bbe0f4717d43c28a7d36e426daf241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:35Z,use_quota=True,user_id='ce29095c8c0f4c0aa58243e1906f7afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc089157-0fa6-40db-a8e4-223330f580ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc089157-0fa6-40db-a8e4-223330f580ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb7d483-6626-4b80-b662-4b06d3d1b537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb7d483-6626-4b80-b662-4b06d3d1b537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089896da-c43f-488a-b9f7-51b96777bc4f', 'volume_name': 'volume-089896da-c43f-488a-b9f7-51b96777bc4f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e86614-f270-4160-b366-04dd5edeb443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e86614-f270-4160-b366-04dd5edeb443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284a8a5b-83f7-40be-b1b9-95eb4d6612af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:34 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Volume 089896da-c43f-488a-b9f7-51b96777bc4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089896da-c43f-488a-b9f7-51b96777bc4f', 'volume_size': 1} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:34 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa Sep 28 19:25:34 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-611ff7c9-44d4-42b1-bd71-196872efe420-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-611ff7c9-44d4-42b1-bd71-196872efe420-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-611ff7c9-44d4-42b1-bd71-196872efe420" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-611ff7c9-44d4-42b1-bd71-196872efe420" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:35 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.497s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:25:35 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d916ed7-7ac1-4f5a-ac49-b82cd7bc33cb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed" returned: 0 in 0.502s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Lock "cinder-quobyte-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed" released by "delete_volume" :: held 1.070s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Created reservations ['3ddfefdb-a66c-4669-8f64-c3f40182dae5', '8f9ae3ad-bc92-4997-b2cd-382cf0930f86', 'a61c5328-c3c3-463d-b351-9b48e9e3e7d5', '75494b4f-ddc3-4d6c-8d50-c466ecb25f64'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:35 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 Sep 28 19:25:35 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:35 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" returned: 0 in 0.385s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1834201062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089896da-c43f-488a-b9f7-51b96777bc4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bbe0f4717d43c28a7d36e426daf241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:35Z,use_quota=True,user_id='ce29095c8c0f4c0aa58243e1906f7afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Creating volume 089896da-c43f-488a-b9f7-51b96777bc4f {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:35 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cc88b8-4047-4d56-a343-ce21a7304eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de8897d-d983-4a12-a9b6-81a5c883c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:35 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f 1073741824 Sep 28 19:25:35 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa (9e8a2741-7594-482f-8e66-fcdfe66fa1fa): created successfully Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de8897d-d983-4a12-a9b6-81a5c883c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (fc8cca81-a9da-4945-89f2-a9741482dd63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-186c4384-41b5-4835-8775-709d06fae5e3 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created volume successfully. Sep 28 19:25:35 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:35 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:35 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:35 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420 Sep 28 19:25:35 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:35 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.332s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Deleted volume successfully. Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad98708a-24e2-48df-949f-bc012ca71556 tempest-ProjectReaderTests-1497888399 None] Lock "cinder-5075d80d-38b3-4abb-8f86-ab91b0a9f0ed-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:35 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f 1073741824" returned: 0 in 0.560s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:35 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-611ff7c9-44d4-42b1-bd71-196872efe420" returned: 0 in 0.321s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:35 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f Sep 28 19:25:35 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-611ff7c9-44d4-42b1-bd71-196872efe420" released by "delete_volume" :: held 0.891s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Created reservations ['1abdab88-480e-49e6-b9f0-0f63c51a8688', '4e3daa89-d499-44dd-812e-ec2743eccdd6', 'eb12cc5a-002d-4f76-857a-fefb4522655b', 'b16337cb-7a42-42fd-9455-445d6f93e855'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:36 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:36 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:36 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f" returned: 0 in 0.360s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284a8a5b-83f7-40be-b1b9-95eb4d6612af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089896da-c43f-488a-b9f7-51b96777bc4f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234a735c-704a-43bc-9a09-bce16d36fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Volume volume-089896da-c43f-488a-b9f7-51b96777bc4f (089896da-c43f-488a-b9f7-51b96777bc4f): created successfully Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234a735c-704a-43bc-9a09-bce16d36fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Flow 'volume_create_manager' (38ff01cf-8e8c-40b6-9d89-8fe615ad9d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Creating offline snapshot 60ffb534-69a2-41ba-b70a-3039323f9b35 of volume 9e8a2741-7594-482f-8e66-fcdfe66fa1fa {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:25:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c306cc13-d005-4473-8859-c0626efed07c tempest-VolumeDependencyTests-953913173 None] Created volume successfully. Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2566671b-ac66-41d4-89d7-139b894dbda5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:36 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:36 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa Sep 28 19:25:36 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Deleted volume successfully. Sep 28 19:25:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-22182ad1-c3d9-429c-a6dc-31d15a883164 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-611ff7c9-44d4-42b1-bd71-196872efe420-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:37 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" returned: 0 in 0.575s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:37 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 1G Sep 28 19:25:37 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (64b7420e-2679-4ae6-a3fc-5ffd2dfde59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b616ad-a30b-4445-9231-6b31a03935fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b616ad-a30b-4445-9231-6b31a03935fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290068758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d53dcef-aa2d-400c-aa5b-b6390da93d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:37Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c0120d-0c99-46cb-8f9f-747b4bc118e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c0120d-0c99-46cb-8f9f-747b4bc118e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c45e04c-eab7-4ede-828a-f934109acb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c45e04c-eab7-4ede-828a-f934109acb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d53dcef-aa2d-400c-aa5b-b6390da93d00', 'volume_name': 'volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb34dce-5afa-4885-8a27-27084a2fd7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb34dce-5afa-4885-8a27-27084a2fd7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20df6227-58f3-4db9-9df5-e014a2085dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Volume 6d53dcef-aa2d-400c-aa5b-b6390da93d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00', 'volume_size': 1} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:37 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 1G" returned: 0 in 0.577s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:37 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 Sep 28 19:25:37 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:37 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:37 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 is being set with open permissions: ugo+rw Sep 28 19:25:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:38 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 Sep 28 19:25:38 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:38 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35" returned: 0 in 0.282s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:38 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.info Sep 28 19:25:38 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:38 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.info" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:38 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.info is being set with open permissions: ugo+rw Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:38 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.info Sep 28 19:25:38 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:38 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.info" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290068758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d53dcef-aa2d-400c-aa5b-b6390da93d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:37Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Creating volume 6d53dcef-aa2d-400c-aa5b-b6390da93d00 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:38 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:38 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 1073741824 Sep 28 19:25:38 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3b432f00-9166-480c-9414-91185ac1cedc tempest-CreateVolumesFromSnapshotTest-2074830252 None] Create snapshot completed successfully Sep 28 19:25:39 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 1073741824" returned: 0 in 0.545s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:39 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 Sep 28 19:25:39 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:39 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00" returned: 0 in 0.312s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.587s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20df6227-58f3-4db9-9df5-e014a2085dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c534a74-0d05-4b7e-85dd-6f18f7b84f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Creating offline snapshot f0eb835e-8bb4-4342-99a7-6808fa30818e of volume 089896da-c43f-488a-b9f7-51b96777bc4f {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:25:39 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Volume volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 (6d53dcef-aa2d-400c-aa5b-b6390da93d00): created successfully Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c534a74-0d05-4b7e-85dd-6f18f7b84f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (64b7420e-2679-4ae6-a3fc-5ffd2dfde59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5f5c04-dfd8-470e-86c6-1552bffc0cb9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b85f7e7d-2975-4950-92b6-096eefb75f6e tempest-ProjectMemberTests-2079916226 None] Created volume successfully. Sep 28 19:25:40 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f Sep 28 19:25:40 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (724a36e2-50f1-4202-abe1-a25bbf966da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50845d81-3c4c-4b91-ae47-780a4c01ec7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50845d81-3c4c-4b91-ae47-780a4c01ec7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-593553669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6529e0f-4c39-4750-a2bb-9af551938ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:40Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc894387-dcb8-475a-9496-c050dc5915d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc894387-dcb8-475a-9496-c050dc5915d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3c7740-8686-44ce-a494-e675acfdc345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3c7740-8686-44ce-a494-e675acfdc345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6529e0f-4c39-4750-a2bb-9af551938ce5', 'volume_name': 'volume-f6529e0f-4c39-4750-a2bb-9af551938ce5', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efd4f02-daef-4209-afa0-08ba1375175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efd4f02-daef-4209-afa0-08ba1375175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc357da8-a7cf-40a2-873e-65d845131411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:40 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume f6529e0f-4c39-4750-a2bb-9af551938ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6529e0f-4c39-4750-a2bb-9af551938ce5', 'volume_size': 1} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:40 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f" returned: 0 in 0.587s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:40 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e 1G Sep 28 19:25:40 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (62baf25f-8514-44e7-ba52-7906b1f3d119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ede7dc8-32ee-4bf6-8cac-ed7c177b308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ede7dc8-32ee-4bf6-8cac-ed7c177b308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-716073254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84384ca3-85a6-4f35-8ea9-f93a81bf46af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:41Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d582d2a-2695-46c8-859f-6df299ebbb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d582d2a-2695-46c8-859f-6df299ebbb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcd9a51-c741-42e9-8be0-f82fff1025a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcd9a51-c741-42e9-8be0-f82fff1025a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84384ca3-85a6-4f35-8ea9-f93a81bf46af', 'volume_name': 'volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d62fc8-58da-4d72-922b-9efd30de4c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d62fc8-58da-4d72-922b-9efd30de4c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fb8baf-f02f-4e65-85d3-d7ec81c41cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume 84384ca3-85a6-4f35-8ea9-f93a81bf46af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af', 'volume_size': 1} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (9be04909-0129-46c9-830c-75b84a250807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:41 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58278ab-f097-4dd9-abe0-57e45c53bba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e 1G" returned: 0 in 0.818s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089896da-c43f-488a-b9f7-51b96777bc4f -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:41 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089896da-c43f-488a-b9f7-51b96777bc4f -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58278ab-f097-4dd9-abe0-57e45c53bba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-711618482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055557ce-a8ba-461b-beb7-0de845bd294d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:41Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:41 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6bb996-2224-4121-bef0-ce3ce8736396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6bb996-2224-4121-bef0-ce3ce8736396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f98517e-879e-40d4-9ace-84895abc2dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f98517e-879e-40d4-9ace-84895abc2dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055557ce-a8ba-461b-beb7-0de845bd294d', 'volume_name': 'volume-055557ce-a8ba-461b-beb7-0de845bd294d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b529d8c-bef4-4202-8a00-16678224b8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b529d8c-bef4-4202-8a00-16678224b8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558d7261-04ff-4df1-b3a7-f7654c5bf666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume 055557ce-a8ba-461b-beb7-0de845bd294d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055557ce-a8ba-461b-beb7-0de845bd294d', 'volume_size': 1} Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:41 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089896da-c43f-488a-b9f7-51b96777bc4f -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e" returned: 0 in 0.478s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:41 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e is being set with open permissions: ugo+rw Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:41 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e Sep 28 19:25:41 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:41 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (a29e85d1-5724-4372-9a65-4711035c46c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5aba8c-c495-4387-917b-a4164ed3d89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5aba8c-c495-4387-917b-a4164ed3d89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-702020447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53580ec6-57a6-45ad-ac5c-d0471054b5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:42Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc807a66-8719-4f22-baba-e3f444718032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc807a66-8719-4f22-baba-e3f444718032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44680eb3-e6c1-4255-8bbd-660402283eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44680eb3-e6c1-4255-8bbd-660402283eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53580ec6-57a6-45ad-ac5c-d0471054b5dd', 'volume_name': 'volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195c46d2-1e5e-4281-a12a-8212112364b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195c46d2-1e5e-4281-a12a-8212112364b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7d9619-258c-45dc-a8ea-0d2b8314c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume 53580ec6-57a6-45ad-ac5c-d0471054b5dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd', 'volume_size': 1} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:42 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e" returned: 0 in 0.377s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:42 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.info Sep 28 19:25:42 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (379373e9-284d-4152-a3bd-abce5c55e3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57f4fd5-912c-444a-acaf-7572579ea310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57f4fd5-912c-444a-acaf-7572579ea310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-46643711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f2ec0f-4f93-4d56-9359-4608d5eca2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:42Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0dd8538-ca39-4c46-853a-1e3403a7709c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0dd8538-ca39-4c46-853a-1e3403a7709c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb46906-66d9-41dc-9006-62954bb3380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb46906-66d9-41dc-9006-62954bb3380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f2ec0f-4f93-4d56-9359-4608d5eca2fa', 'volume_name': 'volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4460e71a-ee2f-4a99-9b01-1317a6d58117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4460e71a-ee2f-4a99-9b01-1317a6d58117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e261987-4f6a-4eec-9997-d192d49204b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume 67f2ec0f-4f93-4d56-9359-4608d5eca2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa', 'volume_size': 1} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:42 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.info" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:42 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.info is being set with open permissions: ugo+rw Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:42 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.info Sep 28 19:25:42 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:42 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.info" returned: 0 in 0.275s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.087s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.592s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-593553669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6529e0f-4c39-4750-a2bb-9af551938ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:40Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Creating volume f6529e0f-4c39-4750-a2bb-9af551938ce5 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:42 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:42 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5 1073741824 Sep 28 19:25:42 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6916887a-4537-4388-9daa-3d2709a2d453 tempest-VolumeDependencyTests-953913173 None] Create snapshot completed successfully Sep 28 19:25:43 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5 1073741824" returned: 0 in 0.496s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:43 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5 Sep 28 19:25:43 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:43 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5" returned: 0 in 0.286s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.783s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc357da8-a7cf-40a2-873e-65d845131411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6529e0f-4c39-4750-a2bb-9af551938ce5', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889ada08-d386-4d5f-ae84-89c93c47eed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Creating offline snapshot 983fb030-cbb6-405e-867e-0b5c2594acea of volume 6d53dcef-aa2d-400c-aa5b-b6390da93d00 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:25:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume volume-f6529e0f-4c39-4750-a2bb-9af551938ce5 (f6529e0f-4c39-4750-a2bb-9af551938ce5): created successfully Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889ada08-d386-4d5f-ae84-89c93c47eed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (724a36e2-50f1-4202-abe1-a25bbf966da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f329ab8d-d698-4d5e-85dc-7d3768adc926]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f1cc850a-452f-4adc-ba05-4d28d7c81d1d tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created volume successfully. Sep 28 19:25:44 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 Sep 28 19:25:44 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:44 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00" returned: 0 in 0.458s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:44 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea 1G Sep 28 19:25:44 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Flow 'volume_create_manager' (28047630-caf2-462e-9599-fb0b00c7b571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45a8d53-3ab8-49cc-8bdb-2e44b27a9584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45a8d53-3ab8-49cc-8bdb-2e44b27a9584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1145697228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f000ff1-d4b6-4090-a57b-639ef78a810d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bbe0f4717d43c28a7d36e426daf241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0eb835e-8bb4-4342-99a7-6808fa30818e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:44Z,use_quota=True,user_id='ce29095c8c0f4c0aa58243e1906f7afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed85ead-f729-47ee-a80d-851ef7d19738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed85ead-f729-47ee-a80d-851ef7d19738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee358529-870b-4d9c-a1da-3bff4dd459a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee358529-870b-4d9c-a1da-3bff4dd459a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f000ff1-d4b6-4090-a57b-639ef78a810d', 'volume_name': 'volume-2f000ff1-d4b6-4090-a57b-639ef78a810d', 'volume_size': 1, 'snapshot_id': 'f0eb835e-8bb4-4342-99a7-6808fa30818e'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47a48ed-dc96-4845-ab98-a2665cbfaa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47a48ed-dc96-4845-ab98-a2665cbfaa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e72bdd3-966c-4b3a-8c80-7f10e5501ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Volume 2f000ff1-d4b6-4090-a57b-639ef78a810d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f000ff1-d4b6-4090-a57b-639ef78a810d', 'volume_size': 1, 'snapshot_id': 'f0eb835e-8bb4-4342-99a7-6808fa30818e'} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:44 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea 1G" returned: 0 in 0.556s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:44 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea Sep 28 19:25:44 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:45 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:45 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea is being set with open permissions: ugo+rw Sep 28 19:25:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:45 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea Sep 28 19:25:45 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:45 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea" returned: 0 in 0.282s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:45 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.info Sep 28 19:25:45 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:45 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.info" returned: 0 in 0.321s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:45 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.info is being set with open permissions: ugo+rw Sep 28 19:25:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:45 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.info Sep 28 19:25:45 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:46 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.info" returned: 0 in 0.337s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.137s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-716073254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84384ca3-85a6-4f35-8ea9-f93a81bf46af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:41Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Creating volume 84384ca3-85a6-4f35-8ea9-f93a81bf46af {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:46 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:46 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af 1073741824 Sep 28 19:25:46 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-da7db8f8-3915-4124-aa38-df6854391b44 tempest-ProjectMemberTests-2079916226 None] Create snapshot completed successfully Sep 28 19:25:46 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af 1073741824" returned: 0 in 0.532s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:46 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af Sep 28 19:25:46 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-983fb030-cbb6-405e-867e-0b5c2594acea-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Lock "cinder-983fb030-cbb6-405e-867e-0b5c2594acea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-6d53dcef-aa2d-400c-aa5b-b6390da93d00" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:47 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af" returned: 0 in 0.380s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.771s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-711618482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055557ce-a8ba-461b-beb7-0de845bd294d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:41Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Creating volume 055557ce-a8ba-461b-beb7-0de845bd294d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:47 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-6d53dcef-aa2d-400c-aa5b-b6390da93d00" acquired by "delete_snapshot" :: waited 0.118s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-983fb030-cbb6-405e-867e-0b5c2594acea" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:47 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d 1073741824 Sep 28 19:25:47 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fb8baf-f02f-4e65-85d3-d7ec81c41cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e77bce3-4080-405c-9a26-a738f8599371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-983fb030-cbb6-405e-867e-0b5c2594acea" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Deleting offline snapshot 983fb030-cbb6-405e-867e-0b5c2594acea of volume 6d53dcef-aa2d-400c-aa5b-b6390da93d00 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] snapshot_file for this snap is: volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:25:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af (84384ca3-85a6-4f35-8ea9-f93a81bf46af): created successfully Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e77bce3-4080-405c-9a26-a738f8599371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (62baf25f-8514-44e7-ba52-7906b1f3d119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc1a4e6-2e53-49a4-9f62-2cec2b4e4d66]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2d54fa51-0eac-4009-a047-76e9f9f5a5ef tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created volume successfully. Sep 28 19:25:47 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea Sep 28 19:25:47 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:47 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea" returned: 0 in 0.550s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:25:47 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d 1073741824" returned: 0 in 0.741s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cc7f95-2cd4-4aa4-93c7-6f2a7a03f6d6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:48 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d Sep 28 19:25:48 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:48 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 Sep 28 19:25:48 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:48 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d" returned: 0 in 0.323s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.298s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-702020447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53580ec6-57a6-45ad-ac5c-d0471054b5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:42Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Creating volume 53580ec6-57a6-45ad-ac5c-d0471054b5dd {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:48 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558d7261-04ff-4df1-b3a7-f7654c5bf666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055557ce-a8ba-461b-beb7-0de845bd294d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:48 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd 1073741824 Sep 28 19:25:48 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb595240-fc75-45c0-b6ee-89b8a55e79a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume volume-055557ce-a8ba-461b-beb7-0de845bd294d (055557ce-a8ba-461b-beb7-0de845bd294d): created successfully Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb595240-fc75-45c0-b6ee-89b8a55e79a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (9be04909-0129-46c9-830c-75b84a250807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9d1a49f3-f02e-459f-bef1-c0798ede1413 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created volume successfully. Sep 28 19:25:48 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00" returned: 0 in 0.566s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:48 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea Sep 28 19:25:48 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:49 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd 1073741824" returned: 0 in 0.630s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:49 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd Sep 28 19:25:49 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:49 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea" returned: 0 in 0.591s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:49 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea Sep 28 19:25:49 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:49 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd" returned: 0 in 0.338s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.867s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-46643711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f2ec0f-4f93-4d56-9359-4608d5eca2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e68dac52f7480e8f1ce1935a4b777a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:42Z,use_quota=True,user_id='3c47b84e319248528249841a5b1a36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Creating volume 67f2ec0f-4f93-4d56-9359-4608d5eca2fa {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:49 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7d9619-258c-45dc-a8ea-0d2b8314c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e591cd-ac17-4947-a531-65dbabcf9f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd (53580ec6-57a6-45ad-ac5c-d0471054b5dd): created successfully Sep 28 19:25:49 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa 1073741824 Sep 28 19:25:49 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e591cd-ac17-4947-a531-65dbabcf9f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (a29e85d1-5724-4372-9a65-4711035c46c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d2672a46-8259-4024-8e3d-90f42110701a tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created volume successfully. Sep 28 19:25:49 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00.983fb030-cbb6-405e-867e-0b5c2594acea" returned: 0 in 0.462s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-983fb030-cbb6-405e-867e-0b5c2594acea" released by "_delete_snapshot" :: held 2.370s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-6d53dcef-aa2d-400c-aa5b-b6390da93d00" released by "delete_snapshot" :: held 2.422s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=222,cinder:SELECT=159,cinder:INSERT=65,cinder:DELETE=18 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Created reservations ['292f093b-48e2-48e1-ad10-3683a82150c6', 'fb24d26c-617d-4cdb-8475-72cd5c039893', '8d3f27f7-9275-419f-b645-6d5d736c95f3', '779c0f88-fffe-42e3-a767-fc675572d960'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Delete snapshot completed successfully. Sep 28 19:25:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-343ee79a-6411-4201-a240-ddfa4eef2a1a tempest-ProjectMemberTests-2079916226 None] Lock "cinder-983fb030-cbb6-405e-867e-0b5c2594acea-delete_snapshot" released by "delete_snapshot" :: held 2.739s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:50 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa 1073741824" returned: 0 in 0.666s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=172,cinder:UPDATE=222,cinder:DELETE=26,cinder:INSERT=49 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:50 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa Sep 28 19:25:50 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-6d53dcef-aa2d-400c-aa5b-b6390da93d00-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Lock "cinder-6d53dcef-aa2d-400c-aa5b-b6390da93d00-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:50 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.909s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Acquiring lock "cinder-quobyte-f0eb835e-8bb4-4342-99a7-6808fa30818e-2f000ff1-d4b6-4090-a57b-639ef78a810d" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e261987-4f6a-4eec-9997-d192d49204b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea32d7f-4549-4085-9e1a-416fcc4adfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-6d53dcef-aa2d-400c-aa5b-b6390da93d00" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-f0eb835e-8bb4-4342-99a7-6808fa30818e-2f000ff1-d4b6-4090-a57b-639ef78a810d" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Creating volume 2f000ff1-d4b6-4090-a57b-639ef78a810d from snapshot f0eb835e-8bb4-4342-99a7-6808fa30818e {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Acquiring lock "cinder-quobyte-2f000ff1-d4b6-4090-a57b-639ef78a810d" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Volume volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa (67f2ec0f-4f93-4d56-9359-4608d5eca2fa): created successfully Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea32d7f-4549-4085-9e1a-416fcc4adfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Flow 'volume_create_manager' (379373e9-284d-4152-a3bd-abce5c55e3f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-2f000ff1-d4b6-4090-a57b-639ef78a810d" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] snapshot: f0eb835e-8bb4-4342-99a7-6808fa30818e, volume: 2f000ff1-d4b6-4090-a57b-639ef78a810d, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-6d53dcef-aa2d-400c-aa5b-b6390da93d00" acquired by "delete_volume" :: waited 0.071s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2ed2fa24-c885-4e34-9742-8ce817eef761 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created volume successfully. Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[349ab079-4107-40c1-bb97-815945eccc30]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd1ce30-6995-4b90-9c09-1fddaf3c4e6a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:50 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 Sep 28 19:25:50 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:50 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e Sep 28 19:25:50 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:51 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00" returned: 0 in 0.460s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:51 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e" returned: 0 in 0.451s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-089896da-c43f-488a-b9f7-51b96777bc4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:25:51 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00 Sep 28 19:25:51 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7031d651-bf30-417c-ac18-2a631d9acbac]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:51 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f Sep 28 19:25:51 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:51 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-6d53dcef-aa2d-400c-aa5b-b6390da93d00" returned: 0 in 0.457s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-6d53dcef-aa2d-400c-aa5b-b6390da93d00" released by "delete_volume" :: held 1.057s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-67f2ec0f-4f93-4d56-9359-4608d5eca2fa-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-67f2ec0f-4f93-4d56-9359-4608d5eca2fa-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Created reservations ['8b3dad3e-c2e2-4fa1-9629-0b3992fa0dd4', '8344d215-3be9-490c-aa02-493a58a3287a', '6cc10da2-8798-4251-843e-4c37714b7ca6', '73eda3e1-5c54-44ad-a196-c3658391cc68'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-quobyte-67f2ec0f-4f93-4d56-9359-4608d5eca2fa" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-67f2ec0f-4f93-4d56-9359-4608d5eca2fa" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:51 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f" returned: 0 in 0.665s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8c9291-148d-480c-bafd-ee09056521b0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:51 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d Sep 28 19:25:51 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:52 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa Sep 28 19:25:52 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:52 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:52 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:52 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:52 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Deleted volume successfully. Sep 28 19:25:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-377598f5-2833-4902-8109-37232975803b tempest-ProjectMemberTests-2079916226 None] Lock "cinder-6d53dcef-aa2d-400c-aa5b-b6390da93d00-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:52 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa" returned: 0 in 0.526s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:52 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa Sep 28 19:25:52 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:53 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-67f2ec0f-4f93-4d56-9359-4608d5eca2fa" returned: 0 in 0.733s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-67f2ec0f-4f93-4d56-9359-4608d5eca2fa" released by "delete_volume" :: held 1.352s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:53 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created reservations ['b27a4bd2-a1e3-49b3-a5ce-f88e22c7ce60', 'a8514429-c548-4e21-98e8-b60b13f47066', 'f4b1e783-9d24-44c8-a3ef-6689649f4bf3', '374958e9-554f-4a86-9eed-dcea2a22c1fa'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:53 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:53 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:54 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.755s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Deleted volume successfully. Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4e195877-59cb-4ecc-8bfd-1fe81e2496de tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-67f2ec0f-4f93-4d56-9359-4608d5eca2fa-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-53580ec6-57a6-45ad-ac5c-d0471054b5dd-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (7445312b-f76b-4724-b511-bc72ce03b934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0757faa7-7802-4e2a-b421-dfb7528dba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0757faa7-7802-4e2a-b421-dfb7528dba0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-127367706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f48aa2-57a7-4342-b54b-77ba268c20f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:54Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8b6ecc-be53-4508-96bf-25930e5077ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8b6ecc-be53-4508-96bf-25930e5077ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1401fc09-bf29-4917-92b7-4883afdc0f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1401fc09-bf29-4917-92b7-4883afdc0f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f48aa2-57a7-4342-b54b-77ba268c20f8', 'volume_name': 'volume-26f48aa2-57a7-4342-b54b-77ba268c20f8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de79aba4-63b0-4284-9d5a-e7f02bde6f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de79aba4-63b0-4284-9d5a-e7f02bde6f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271be0b0-7695-4f18-847a-5b479c2ee8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:25:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Volume 26f48aa2-57a7-4342-b54b-77ba268c20f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f48aa2-57a7-4342-b54b-77ba268c20f8', 'volume_size': 1} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-53580ec6-57a6-45ad-ac5c-d0471054b5dd-delete_volume" acquired by "delete_volume" :: waited 0.190s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-quobyte-53580ec6-57a6-45ad-ac5c-d0471054b5dd" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-53580ec6-57a6-45ad-ac5c-d0471054b5dd" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff609424-25f5-421f-bf77-59d429006e74]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:55 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd Sep 28 19:25:55 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:55 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd" returned: 0 in 0.917s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:55 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd Sep 28 19:25:55 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:56 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-53580ec6-57a6-45ad-ac5c-d0471054b5dd" returned: 0 in 0.386s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-53580ec6-57a6-45ad-ac5c-d0471054b5dd" released by "delete_volume" :: held 1.397s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created reservations ['f8ec190e-2f78-4dcc-9fee-1870d8fef3b0', '34b447e1-2eeb-4e60-9243-30abe18060fb', '91bc09ee-68b7-48e3-9f37-7bf0a823bf21', 'a82f16a6-f1c9-4451-8e08-ce00c2c6c9ad'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:56 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:56 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:56 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.453s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:25:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Deleted volume successfully. Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-258a0de1-b2e6-4ac4-8b46-f89a096cf040 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-53580ec6-57a6-45ad-ac5c-d0471054b5dd-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-055557ce-a8ba-461b-beb7-0de845bd294d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-055557ce-a8ba-461b-beb7-0de845bd294d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-quobyte-055557ce-a8ba-461b-beb7-0de845bd294d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:25:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-055557ce-a8ba-461b-beb7-0de845bd294d" acquired by "delete_volume" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:25:57 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a09b9-1179-45e9-81f2-be60aab5dc3f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:25:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:57 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d Sep 28 19:25:57 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:58 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d" returned: 0 in 1.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:58 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d Sep 28 19:25:58 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:59 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-055557ce-a8ba-461b-beb7-0de845bd294d" returned: 0 in 0.643s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-055557ce-a8ba-461b-beb7-0de845bd294d" released by "delete_volume" :: held 2.026s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created reservations ['f6bb6449-4c12-4fa7-a591-3eeeec5b6956', '9fc98723-4aa2-4401-b0da-cd7c95bf7105', '2bc357cf-a170-4197-b633-13daa51c69d4', '3cac8499-9971-434d-bdcd-694243923c95'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:25:59 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:25:59 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:25:59 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.424s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:25:59 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Deleted volume successfully. Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-98c60032-0e35-4899-a441-71450f116a5e tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-055557ce-a8ba-461b-beb7-0de845bd294d-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-84384ca3-85a6-4f35-8ea9-f93a81bf46af-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-84384ca3-85a6-4f35-8ea9-f93a81bf46af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:00 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d" returned: 0 in 8.739s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f, size 1024.00 MB, duration 8.74 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:26:00 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Converted 1024.00 MB image at 117.14 MB/s Sep 28 19:26:00 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d is being set with open permissions: ugo+rw Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:00 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d Sep 28 19:26:00 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-quobyte-84384ca3-85a6-4f35-8ea9-f93a81bf46af" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-84384ca3-85a6-4f35-8ea9-f93a81bf46af" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c922b8b-35a2-47ab-a648-24d80eca0847]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:00 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af Sep 28 19:26:00 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:00 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-2f000ff1-d4b6-4090-a57b-639ef78a810d" released by "_copy_volume_from_snapshot" :: held 10.337s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-f0eb835e-8bb4-4342-99a7-6808fa30818e-2f000ff1-d4b6-4090-a57b-639ef78a810d" released by "_create_volume_from_snapshot" :: held 10.456s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.512s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.433s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-127367706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f48aa2-57a7-4342-b54b-77ba268c20f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:25:54Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Creating volume 26f48aa2-57a7-4342-b54b-77ba268c20f8 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:26:00 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:26:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:01 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 1073741824 Sep 28 19:26:01 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e72bdd3-966c-4b3a-8c80-7f10e5501ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f000ff1-d4b6-4090-a57b-639ef78a810d', 'volume_size': 1, 'snapshot_id': 'f0eb835e-8bb4-4342-99a7-6808fa30818e'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc76c64c-fcb5-4713-9c29-cb973679210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:01 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Volume volume-2f000ff1-d4b6-4090-a57b-639ef78a810d (2f000ff1-d4b6-4090-a57b-639ef78a810d): created successfully Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc76c64c-fcb5-4713-9c29-cb973679210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Flow 'volume_create_manager' (28047630-caf2-462e-9599-fb0b00c7b571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:01 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fa1f2b0c-8305-4e1c-bba7-e023c6519cbb tempest-VolumeDependencyTests-953913173 None] Created volume successfully. Sep 28 19:26:01 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af Sep 28 19:26:01 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Acquiring lock "cinder-f0eb835e-8bb4-4342-99a7-6808fa30818e-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Lock "cinder-f0eb835e-8bb4-4342-99a7-6808fa30818e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Acquiring lock "cinder-quobyte-089896da-c43f-488a-b9f7-51b96777bc4f" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-089896da-c43f-488a-b9f7-51b96777bc4f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Acquiring lock "cinder-quobyte-f0eb835e-8bb4-4342-99a7-6808fa30818e" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-f0eb835e-8bb4-4342-99a7-6808fa30818e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Deleting offline snapshot f0eb835e-8bb4-4342-99a7-6808fa30818e of volume 089896da-c43f-488a-b9f7-51b96777bc4f {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] snapshot_file for this snap is: volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[214ff9f5-2a9b-42c2-8c7d-1f2ca5ef2780]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:01 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-84384ca3-85a6-4f35-8ea9-f93a81bf46af" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-84384ca3-85a6-4f35-8ea9-f93a81bf46af" released by "delete_volume" :: held 0.822s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:01 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e Sep 28 19:26:01 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created reservations ['d2d033f6-2e89-48de-90af-8b6c482cb0ef', '3d3935da-cf4b-4a0c-9dd1-4c45e263e7aa', 'b163bb49-db0c-4e5a-a575-0dd564744704', 'f84fbd65-2abc-496e-8376-31e3fd14b18e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:01 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 1073741824" returned: 0 in 0.626s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:01 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:01 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:01 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:01 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-f6529e0f-4c39-4750-a2bb-9af551938ce5-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-f6529e0f-4c39-4750-a2bb-9af551938ce5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-quobyte-f6529e0f-4c39-4750-a2bb-9af551938ce5" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-f6529e0f-4c39-4750-a2bb-9af551938ce5" acquired by "delete_volume" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f45bd6-e2bc-4922-ad5e-a0778ebfa758]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:02 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e" returned: 0 in 0.718s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-089896da-c43f-488a-b9f7-51b96777bc4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:26:02 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8" returned: 0 in 0.500s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271be0b0-7695-4f18-847a-5b479c2ee8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f48aa2-57a7-4342-b54b-77ba268c20f8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb0c2fc-bca8-42dd-a954-7b23415dd6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[825dba77-8859-4d88-b196-c23a57b5ef37]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Volume volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 (26f48aa2-57a7-4342-b54b-77ba268c20f8): created successfully Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb0c2fc-bca8-42dd-a954-7b23415dd6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (7445312b-f76b-4724-b511-bc72ce03b934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:02 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f70c7d41-2991-4cfa-a3ba-94178bcd9ff7 tempest-ProjectMemberTests-2079916226 None] Created volume successfully. Sep 28 19:26:02 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5 Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.559s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:02 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Deleted volume successfully. Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1b9d4e0-dd1c-4234-95f3-021431fb464f tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-84384ca3-85a6-4f35-8ea9-f93a81bf46af-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:02 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f Sep 28 19:26:02 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:02 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5" returned: 0 in 0.496s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:02 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5 Sep 28 19:26:02 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:02 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f" returned: 0 in 0.642s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:02 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f6529e0f-4c39-4750-a2bb-9af551938ce5" returned: 0 in 0.271s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:02 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e Sep 28 19:26:02 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-f6529e0f-4c39-4750-a2bb-9af551938ce5" released by "delete_volume" :: held 0.841s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created reservations ['2838eb09-b333-44d7-aafa-33d53bffdd08', 'c8365f4f-1e20-4a9c-863a-fc2c684c447f', '7b88fe8b-10ff-4702-9ea5-01c246cac52a', '14725a83-2523-4d20-9a71-a6dfe52ae10b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:03 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:03 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-60ffb534-69a2-41ba-b70a-3039323f9b35-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-60ffb534-69a2-41ba-b70a-3039323f9b35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-quobyte-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-quobyte-60ffb534-69a2-41ba-b70a-3039323f9b35" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-60ffb534-69a2-41ba-b70a-3039323f9b35" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Deleting offline snapshot 60ffb534-69a2-41ba-b70a-3039323f9b35 of volume 9e8a2741-7594-482f-8e66-fcdfe66fa1fa {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] snapshot_file for this snap is: volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2255754-bf0a-4658-a34e-3e23647d2749]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:03 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e" returned: 0 in 0.620s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:03 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e Sep 28 19:26:03 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:03 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.521s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Deleted volume successfully. Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Creating offline snapshot c08a12b5-3bc5-4e02-8581-e1a0689aa8ca of volume 26f48aa2-57a7-4342-b54b-77ba268c20f8 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-95fdef8a-48a6-4502-9cfb-6d497a965db7 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-f6529e0f-4c39-4750-a2bb-9af551938ce5-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05cb9f7-cd14-4c33-99a2-210e392c8365]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:03 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 Sep 28 19:26:03 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:03 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 Sep 28 19:26:03 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:03 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f.f0eb835e-8bb4-4342-99a7-6808fa30818e" returned: 0 in 0.505s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-f0eb835e-8bb4-4342-99a7-6808fa30818e" released by "_delete_snapshot" :: held 2.669s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-089896da-c43f-488a-b9f7-51b96777bc4f" released by "delete_snapshot" :: held 2.705s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:04 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35" returned: 0 in 0.761s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b34f05-c703-4fcd-8c91-7a58633a6b33]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Created reservations ['8fc2af39-5bcf-4e19-a202-f47f373398a4', '411e0d4a-a6c6-40a1-b036-ecc8e84fe824', '7a3c2461-c2a3-4c73-9f31-2a5737dfc45a', '70ab252a-a0ec-4a5b-8c7a-5d16f203b236'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Delete snapshot completed successfully. Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5a88080-05e6-44f2-83b2-edbec0c88cfa tempest-VolumeDependencyTests-953913173 None] Lock "cinder-f0eb835e-8bb4-4342-99a7-6808fa30818e-delete_snapshot" released by "delete_snapshot" :: held 2.968s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:04 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8" returned: 0 in 0.639s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:04 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa Sep 28 19:26:04 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:04 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca 1G Sep 28 19:26:04 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Acquiring lock "cinder-089896da-c43f-488a-b9f7-51b96777bc4f-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Lock "cinder-089896da-c43f-488a-b9f7-51b96777bc4f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:04 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" returned: 0 in 0.502s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:04 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 Sep 28 19:26:04 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Acquiring lock "cinder-quobyte-089896da-c43f-488a-b9f7-51b96777bc4f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-089896da-c43f-488a-b9f7-51b96777bc4f" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ecee2-062b-4191-919a-0d34278821da]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:04 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca 1G" returned: 0 in 0.648s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:04 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f Sep 28 19:26:04 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:04 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca Sep 28 19:26:04 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:05 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35" returned: 0 in 0.519s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:05 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35 Sep 28 19:26:05 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:05 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f" returned: 0 in 0.488s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:05 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f Sep 28 19:26:05 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:05 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:05 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca is being set with open permissions: ugo+rw Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:05 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca Sep 28 19:26:05 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:05 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa.60ffb534-69a2-41ba-b70a-3039323f9b35" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:05 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-089896da-c43f-488a-b9f7-51b96777bc4f" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-60ffb534-69a2-41ba-b70a-3039323f9b35" released by "_delete_snapshot" :: held 2.351s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-089896da-c43f-488a-b9f7-51b96777bc4f" released by "delete_volume" :: held 0.902s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" released by "delete_snapshot" :: held 2.393s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Created reservations ['1b1f4fa5-68a1-4fc2-9f8d-e263bef931cc', '98c90f45-e219-481e-b4ad-92caac7b4995', '6aadbf25-36f4-425f-b35e-860c65e9b4e4', 'b9aa1eb1-a285-424d-bcca-f9ae81c02019'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:05 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca" returned: 0 in 0.377s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created reservations ['66112840-a963-4eb9-91a2-1bd9cd7d1fe6', 'b92388fd-6a4e-4156-a6f7-8fb5c24db053', '64021054-4133-4a35-82e0-957adedaf3ba', '0c4f7d87-02ce-49d6-ac60-27fd9c9b44eb'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:05 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.info Sep 28 19:26:05 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:05 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:05 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Delete snapshot completed successfully. Sep 28 19:26:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2485e59a-2039-49b5-bd8d-50048e3a96b6 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-60ffb534-69a2-41ba-b70a-3039323f9b35-delete_snapshot" released by "delete_snapshot" :: held 2.750s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:06 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.info" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:06 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.info is being set with open permissions: ugo+rw Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:06 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.info Sep 28 19:26:06 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:06 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Deleted volume successfully. Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6d86c64b-a311-4188-a14c-2b3e7b8f7536 tempest-VolumeDependencyTests-953913173 None] Lock "cinder-089896da-c43f-488a-b9f7-51b96777bc4f-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:06 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.info" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.883s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-9e8a2741-7594-482f-8e66-fcdfe66fa1fa-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a54c7236-8b44-4255-923f-c3b836748200 tempest-ProjectMemberTests-2079916226 None] Create snapshot completed successfully Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-9e8a2741-7594-482f-8e66-fcdfe66fa1fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "cinder-quobyte-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4368d761-7c7e-42cd-bb38-916a40604f37]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-c08a12b5-3bc5-4e02-8581-e1a0689aa8ca-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Lock "cinder-c08a12b5-3bc5-4e02-8581-e1a0689aa8ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-26f48aa2-57a7-4342-b54b-77ba268c20f8" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-26f48aa2-57a7-4342-b54b-77ba268c20f8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-c08a12b5-3bc5-4e02-8581-e1a0689aa8ca" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-c08a12b5-3bc5-4e02-8581-e1a0689aa8ca" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:06 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa Sep 28 19:26:06 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Deleting offline snapshot c08a12b5-3bc5-4e02-8581-e1a0689aa8ca of volume 26f48aa2-57a7-4342-b54b-77ba268c20f8 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] snapshot_file for this snap is: volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b996aee-11ce-45cd-93d9-03090ca0d675]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Acquiring lock "cinder-2f000ff1-d4b6-4090-a57b-639ef78a810d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Lock "cinder-2f000ff1-d4b6-4090-a57b-639ef78a810d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Acquiring lock "cinder-quobyte-2f000ff1-d4b6-4090-a57b-639ef78a810d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-2f000ff1-d4b6-4090-a57b-639ef78a810d" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:07 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca Sep 28 19:26:07 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a60cf6-5756-418a-96fb-c6a539219d97]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:07 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" returned: 0 in 0.552s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:07 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa Sep 28 19:26:07 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:07 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d Sep 28 19:26:07 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:07 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca" returned: 0 in 0.608s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26f48aa2-57a7-4342-b54b-77ba268c20f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6251faf-8324-4a57-8b9e-f92ece66d213]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:07 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" returned: 0 in 0.396s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-quobyte-9e8a2741-7594-482f-8e66-fcdfe66fa1fa" released by "delete_volume" :: held 1.066s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:07 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d" returned: 0 in 0.499s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:07 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d Sep 28 19:26:07 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:07 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Created reservations ['ed09051f-c9d7-4ad9-9b9c-1fa9316bb0e0', '17b6ad36-a8db-4562-868c-46ea58178dbd', 'e5013a7c-772f-4b5c-bd82-9a65d39149e7', '6fde26aa-d9c3-4d56-bfb4-01c1538d7f0a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:07 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:07 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:07 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:08 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-2f000ff1-d4b6-4090-a57b-639ef78a810d" returned: 0 in 0.386s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Lock "cinder-quobyte-2f000ff1-d4b6-4090-a57b-639ef78a810d" released by "delete_volume" :: held 0.953s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:08 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8" returned: 0 in 0.531s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:08 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca Sep 28 19:26:08 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Created reservations ['2ae561e0-e8d4-4639-b016-f30ee7809955', '79ccc9c6-e11f-4845-bb02-2f1ece7ad3cb', 'a88320f4-d664-428a-b800-f2edeedc663d', '3ee96f3f-5817-4cf8-9664-8be1c5c11157'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:08 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.406s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Deleted volume successfully. Sep 28 19:26:08 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:08 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-58c372e7-ac21-43fc-b402-a1d5f084f0f4 tempest-CreateVolumesFromSnapshotTest-2074830252 None] Lock "cinder-9e8a2741-7594-482f-8e66-fcdfe66fa1fa-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:08 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:08 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Deleted volume successfully. Sep 28 19:26:08 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca Sep 28 19:26:08 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8af6a3aa-ddc4-4795-be4f-3dd0d79fe403 tempest-VolumeDependencyTests-953913173 None] Lock "cinder-2f000ff1-d4b6-4090-a57b-639ef78a810d-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:08 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8.c08a12b5-3bc5-4e02-8581-e1a0689aa8ca" returned: 0 in 0.311s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-c08a12b5-3bc5-4e02-8581-e1a0689aa8ca" released by "_delete_snapshot" :: held 2.167s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-26f48aa2-57a7-4342-b54b-77ba268c20f8" released by "delete_snapshot" :: held 2.204s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:09 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Created reservations ['9f193615-23bf-40d5-9cb4-62326cd6e0c9', 'bae71c80-6f9e-4388-9747-9b269707ed28', '513ac3a4-4898-4873-a00f-538797a9d8a0', '514a9c09-6f71-4982-a50d-b7df4489acad'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Delete snapshot completed successfully. Sep 28 19:26:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b99e9f18-d17b-4086-90d1-bf9264783c7c tempest-ProjectMemberTests-2079916226 None] Lock "cinder-c08a12b5-3bc5-4e02-8581-e1a0689aa8ca-delete_snapshot" released by "delete_snapshot" :: held 2.412s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-26f48aa2-57a7-4342-b54b-77ba268c20f8-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-26f48aa2-57a7-4342-b54b-77ba268c20f8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-26f48aa2-57a7-4342-b54b-77ba268c20f8" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-26f48aa2-57a7-4342-b54b-77ba268c20f8" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[007c3664-9b0e-49d7-8bb9-027090b6880c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:10 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 Sep 28 19:26:10 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:10 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8" returned: 0 in 0.538s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:10 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8 Sep 28 19:26:10 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:11 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-26f48aa2-57a7-4342-b54b-77ba268c20f8" returned: 0 in 0.548s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-26f48aa2-57a7-4342-b54b-77ba268c20f8" released by "delete_volume" :: held 1.191s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Created reservations ['90490d88-9266-4e4f-acd0-90f8bd824318', '18b86c77-e534-4fb8-9113-9aefbf7436e5', '7a2ac71e-d2a7-41a0-8dd4-197ea2a20881', '4f9fec07-b52e-4b12-8d97-50d8ae6ea050'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:11 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:11 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:11 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.417s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Deleted volume successfully. Sep 28 19:26:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-708b3116-7962-44ef-88eb-2d96d29a6db8 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-26f48aa2-57a7-4342-b54b-77ba268c20f8-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Flow 'volume_create_manager' (4d14a96d-d018-428c-b96a-5754a23f17eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfe2cfd-43c7-4f9b-b056-db1b50c0fb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfe2cfd-43c7-4f9b-b056-db1b50c0fb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-376965702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97dd4bf8-26e0-451d-be93-a4c52bb392fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a6a27e2dea4216a6548a58757788e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:12Z,use_quota=True,user_id='373190dcd7c84408a3400a50230a0443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b926a0-f6b4-4bca-9d69-ec0894de7fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b926a0-f6b4-4bca-9d69-ec0894de7fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fec96b-7561-42dc-a153-32bb938f425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fec96b-7561-42dc-a153-32bb938f425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97dd4bf8-26e0-451d-be93-a4c52bb392fb', 'volume_name': 'volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af98cc6-baa0-450d-83dd-5cd6d4c07863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af98cc6-baa0-450d-83dd-5cd6d4c07863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc4b0c0-2b06-4814-a35e-84a9c01ae4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Volume 97dd4bf8-26e0-451d-be93-a4c52bb392fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb', 'volume_size': 1} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-376965702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97dd4bf8-26e0-451d-be93-a4c52bb392fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a6a27e2dea4216a6548a58757788e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:12Z,use_quota=True,user_id='373190dcd7c84408a3400a50230a0443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Creating volume 97dd4bf8-26e0-451d-be93-a4c52bb392fb {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:26:12 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:12 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb 1073741824 Sep 28 19:26:12 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:12 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb 1073741824" returned: 0 in 0.670s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (2cde827d-987d-40ed-9f1f-7aca312651cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7623f12b-27fe-4a51-ad49-1a1f1b16d01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7623f12b-27fe-4a51-ad49-1a1f1b16d01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707885885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b4e870-8343-4d88-850f-4fb026efc213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:13Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624d48c5-3483-4abd-8de6-13c6e94b0794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624d48c5-3483-4abd-8de6-13c6e94b0794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7808d11-6d50-45ff-a690-428979d3c5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7808d11-6d50-45ff-a690-428979d3c5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b4e870-8343-4d88-850f-4fb026efc213', 'volume_name': 'volume-38b4e870-8343-4d88-850f-4fb026efc213', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5778f72f-2ddf-4a99-9762-b0ddbbd2ba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5778f72f-2ddf-4a99-9762-b0ddbbd2ba27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d63a980-7728-453b-8310-50cad8dd1ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Volume 38b4e870-8343-4d88-850f-4fb026efc213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b4e870-8343-4d88-850f-4fb026efc213', 'volume_size': 1} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:13 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb Sep 28 19:26:13 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:13 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb" returned: 0 in 0.275s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.287s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707885885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b4e870-8343-4d88-850f-4fb026efc213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:13Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Creating volume 38b4e870-8343-4d88-850f-4fb026efc213 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:26:13 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc4b0c0-2b06-4814-a35e-84a9c01ae4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ac7213-9c49-47a5-85e3-08110c70f379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:13 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 1073741824 Sep 28 19:26:13 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Volume volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb (97dd4bf8-26e0-451d-be93-a4c52bb392fb): created successfully Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ac7213-9c49-47a5-85e3-08110c70f379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Flow 'volume_create_manager' (4d14a96d-d018-428c-b96a-5754a23f17eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9c0519af-367d-4b25-96e7-1b79f9e3fea0 tempest-SnapshotDependencyTests-670949352 None] Created volume successfully. Sep 28 19:26:13 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 1073741824" returned: 0 in 0.558s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:14 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 Sep 28 19:26:14 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:14 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213" returned: 0 in 0.332s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d63a980-7728-453b-8310-50cad8dd1ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b4e870-8343-4d88-850f-4fb026efc213', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b68c23c-3b58-4a89-9223-cb0b264f58eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Volume volume-38b4e870-8343-4d88-850f-4fb026efc213 (38b4e870-8343-4d88-850f-4fb026efc213): created successfully Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b68c23c-3b58-4a89-9223-cb0b264f58eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (2cde827d-987d-40ed-9f1f-7aca312651cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a45eb408-4e39-4c4a-b56d-e16c9bfc8ce3 tempest-ProjectMemberTests-2079916226 None] Created volume successfully. Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Creating offline snapshot 89e53d38-9299-462b-9210-3a5eca681661 of volume 97dd4bf8-26e0-451d-be93-a4c52bb392fb {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e9f421-de11-4566-8019-5613d22a2ca4]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Flow 'volume_create_manager' (7e902ba5-e21c-4a95-875a-41095dd9d3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf69447-8e01-45cb-880c-9d78259114c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:14 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb Sep 28 19:26:14 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf69447-8e01-45cb-880c-9d78259114c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a7f7f6-1e84-4502-94cf-2fb986b25ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae8c6142f104bb3a2a30761b297bcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:15Z,use_quota=True,user_id='f202ce09532f4448a6bda483e5a032f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbe5e79-a420-4cf7-a302-6b96b12c7d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbe5e79-a420-4cf7-a302-6b96b12c7d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80e7a6b-e9de-47e2-a890-811b1153926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80e7a6b-e9de-47e2-a890-811b1153926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a7f7f6-1e84-4502-94cf-2fb986b25ff2', 'volume_name': 'volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce2052f-360b-48a2-a152-67dbddc947e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce2052f-360b-48a2-a152-67dbddc947e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f36e35b-8e42-4ccc-a4b3-dcb7f32fadba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Volume 78a7f7f6-1e84-4502-94cf-2fb986b25ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2', 'volume_size': 1} Sep 28 19:26:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:15 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb" returned: 0 in 0.485s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:15 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 1G Sep 28 19:26:15 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:15 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 1G" returned: 0 in 0.562s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:15 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 Sep 28 19:26:15 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:16 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:16 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 is being set with open permissions: ugo+rw Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:16 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 Sep 28 19:26:16 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:16 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661" returned: 0 in 0.271s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:16 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.info Sep 28 19:26:16 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:16 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.info" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:16 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.info is being set with open permissions: ugo+rw Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:16 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.info Sep 28 19:26:16 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:16 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.info" returned: 0 in 0.261s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a7f7f6-1e84-4502-94cf-2fb986b25ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae8c6142f104bb3a2a30761b297bcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:15Z,use_quota=True,user_id='f202ce09532f4448a6bda483e5a032f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Creating volume 78a7f7f6-1e84-4502-94cf-2fb986b25ff2 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:26:16 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:26:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:17 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2 1073741824 Sep 28 19:26:17 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a0a33236-66b8-4f26-acf2-af9967e35dae tempest-SnapshotDependencyTests-670949352 None] Create snapshot completed successfully Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Flow 'volume_create_manager' (aa9d9e6a-815f-4df4-9cf4-250e84a1e01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec85449-7fa2-41cf-a798-9c84408478f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec85449-7fa2-41cf-a798-9c84408478f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f446165-180a-49d5-b343-a21034c2a456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384d402c1ebb47abba22a3c00ca30caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:17Z,use_quota=True,user_id='67e920a836e14dd29c4f30508f5a846f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a78cf0-0ddc-4540-8a1a-2efc2f0046ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a78cf0-0ddc-4540-8a1a-2efc2f0046ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5d8136-a63d-4242-8823-d4c3d81c20d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 19:26:17 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2 1073741824" returned: 0 in 0.509s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:17 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2 Sep 28 19:26:17 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5d8136-a63d-4242-8823-d4c3d81c20d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f446165-180a-49d5-b343-a21034c2a456', 'volume_name': 'volume-7f446165-180a-49d5-b343-a21034c2a456', 'volume_size': 1, 'image_id': '6990deb9-76cf-4031-82d9-5706b3e61b6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6990deb9-76cf-4031-82d9-5706b3e61b6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc8637f814fc49ad80cd9d95efaeca17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '384d402c1ebb47abba22a3c00ca30caa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '452290472a8771d6efd29c6efbed1a3b8d35b4561755f4eb93dffda808c9830f4e9e8a037e64869ff5e277fc210d7a585ae306047cb88b7e5e4d42fe200db012', 'id': '6990deb9-76cf-4031-82d9-5706b3e61b6e', 'created_at': datetime.datetime(2026, 9, 28, 17, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 26, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6990deb9-76cf-4031-82d9-5706b3e61b6e/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea21d75-d231-4022-93e6-81b689fe7989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea21d75-d231-4022-93e6-81b689fe7989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fdc235-c9d4-431a-8d2f-4ef6d29402c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:17 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Volume 7f446165-180a-49d5-b343-a21034c2a456: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f446165-180a-49d5-b343-a21034c2a456', 'volume_size': 1, 'image_id': '6990deb9-76cf-4031-82d9-5706b3e61b6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6990deb9-76cf-4031-82d9-5706b3e61b6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc8637f814fc49ad80cd9d95efaeca17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '384d402c1ebb47abba22a3c00ca30caa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '452290472a8771d6efd29c6efbed1a3b8d35b4561755f4eb93dffda808c9830f4e9e8a037e64869ff5e277fc210d7a585ae306047cb88b7e5e4d42fe200db012', 'id': '6990deb9-76cf-4031-82d9-5706b3e61b6e', 'created_at': datetime.datetime(2026, 9, 28, 17, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 26, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6990deb9-76cf-4031-82d9-5706b3e61b6e/file', 'properties': {}}, 'image_service': } Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Trying to clone 7f446165-180a-49d5-b343-a21034c2a456 from image 6990deb9-76cf-4031-82d9-5706b3e61b6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/6990deb9-76cf-4031-82d9-5706b3e61b6e', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 19:26:17 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Image download 0.00 MB at 0.00 MB/s Sep 28 19:26:17 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.547s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Creating offline snapshot faee19b3-0d3f-4b0b-8b25-7782b8fc743c of volume 38b4e870-8343-4d88-850f-4fb026efc213 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f36e35b-8e42-4ccc-a4b3-dcb7f32fadba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dbaa29-451a-4ce5-bab7-330538221864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e520f342-5233-460d-a8a6-9530f2388500]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9e109-4e7d-418c-894b-d8c402cad648]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:17 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Volume volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2 (78a7f7f6-1e84-4502-94cf-2fb986b25ff2): created successfully Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dbaa29-451a-4ce5-bab7-330538221864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Flow 'volume_create_manager' (7e902ba5-e21c-4a95-875a-41095dd9d3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9413a264-eac0-4bb3-884c-08e4de9173c3 tempest-CinderUnicodeTest-841031656 None] Created volume successfully. Sep 28 19:26:18 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 Sep 28 19:26:18 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:18 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD Sep 28 19:26:18 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:18 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:18 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213" returned: 0 in 0.469s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:18 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c 1G Sep 28 19:26:18 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:18 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD Sep 28 19:26:18 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Flow 'volume_create_manager' (45be63f4-2aab-4f32-b4f3-798868148948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f646cc9-a095-4ec2-a78c-50b380de9282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f646cc9-a095-4ec2-a78c-50b380de9282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95237930-8e88-4417-9599-4722fea47325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a6a27e2dea4216a6548a58757788e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=89e53d38-9299-462b-9210-3a5eca681661,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:18Z,use_quota=True,user_id='373190dcd7c84408a3400a50230a0443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073615eb-d509-4274-817c-297b307f5990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073615eb-d509-4274-817c-297b307f5990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81665fef-6a98-4d8c-b546-6873766e34dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81665fef-6a98-4d8c-b546-6873766e34dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '95237930-8e88-4417-9599-4722fea47325', 'volume_name': 'volume-95237930-8e88-4417-9599-4722fea47325', 'volume_size': 1, 'snapshot_id': '89e53d38-9299-462b-9210-3a5eca681661'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c869367-d5a3-45f9-8652-7a3a4e3a4763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c869367-d5a3-45f9-8652-7a3a4e3a4763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c316e58-1ba7-4600-9597-24b62e41d3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:18 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Volume 95237930-8e88-4417-9599-4722fea47325: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-95237930-8e88-4417-9599-4722fea47325', 'volume_size': 1, 'snapshot_id': '89e53d38-9299-462b-9210-3a5eca681661'} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:18 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Temporary image 6990deb9-76cf-4031-82d9-5706b3e61b6e is fetched for user 67e920a836e14dd29c4f30508f5a846f. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1883c2fb-5563-4af8-a269-7ae4fdd416c4]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:18 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c 1G" returned: 0 in 0.467s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b4e870-8343-4d88-850f-4fb026efc213 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:18 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD Sep 28 19:26:18 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:18 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b4e870-8343-4d88-850f-4fb026efc213 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c Sep 28 19:26:18 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:19 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:19 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b4e870-8343-4d88-850f-4fb026efc213 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:19 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c is being set with open permissions: ugo+rw Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:19 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c Sep 28 19:26:19 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:19 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD Sep 28 19:26:19 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:19 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:19 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:19 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.info Sep 28 19:26:19 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Flow 'volume_create_manager' (c16458ed-8807-4665-821d-b77c1a26820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153d7edf-302d-43d2-89aa-83a44317fa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153d7edf-302d-43d2-89aa-83a44317fa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1804678420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a7f497-4fbb-4733-9026-a8c94a1b6daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae8c6142f104bb3a2a30761b297bcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:20Z,use_quota=True,user_id='f202ce09532f4448a6bda483e5a032f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71482c20-ad35-4c74-9e13-f0ff4c778916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71482c20-ad35-4c74-9e13-f0ff4c778916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b7ab6f-8d58-42c1-bbbd-a3a9bdb75f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b7ab6f-8d58-42c1-bbbd-a3a9bdb75f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a7f497-4fbb-4733-9026-a8c94a1b6daa', 'volume_name': 'volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cad769-7711-4f7d-b7b2-34938016e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cad769-7711-4f7d-b7b2-34938016e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16f2fce-ed93-4186-828b-8e9ac881f4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:19 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Volume 05a7f497-4fbb-4733-9026-a8c94a1b6daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa', 'volume_size': 1} Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:19 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.info" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:19 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.info is being set with open permissions: ugo+rw Sep 28 19:26:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:19 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.info Sep 28 19:26:19 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:20 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.info" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.502s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "cinder-quobyte-89e53d38-9299-462b-9210-3a5eca681661-95237930-8e88-4417-9599-4722fea47325" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-89e53d38-9299-462b-9210-3a5eca681661-95237930-8e88-4417-9599-4722fea47325" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Creating volume 95237930-8e88-4417-9599-4722fea47325 from snapshot 89e53d38-9299-462b-9210-3a5eca681661 {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "cinder-quobyte-95237930-8e88-4417-9599-4722fea47325" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-694d686b-c9e2-4ca4-ba3d-c4205ced88f7 tempest-ProjectMemberTests-2079916226 None] Create snapshot completed successfully Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-95237930-8e88-4417-9599-4722fea47325" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] snapshot: 89e53d38-9299-462b-9210-3a5eca681661, volume: 95237930-8e88-4417-9599-4722fea47325, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b922af3b-1b68-429b-94f3-69ef09e3ac0e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:20 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 Sep 28 19:26:20 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:20 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-faee19b3-0d3f-4b0b-8b25-7782b8fc743c-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661" returned: 0 in 0.429s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Lock "cinder-faee19b3-0d3f-4b0b-8b25-7782b8fc743c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-38b4e870-8343-4d88-850f-4fb026efc213" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21f8cc1-dc7a-4fb6-9c59-150d9738673a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-38b4e870-8343-4d88-850f-4fb026efc213" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-faee19b3-0d3f-4b0b-8b25-7782b8fc743c" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-faee19b3-0d3f-4b0b-8b25-7782b8fc743c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Deleting offline snapshot faee19b3-0d3f-4b0b-8b25-7782b8fc743c of volume 38b4e870-8343-4d88-850f-4fb026efc213 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] snapshot_file for this snap is: volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c62067b-98f8-4411-973d-3054d465ac1b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:20 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb Sep 28 19:26:20 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:20 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c Sep 28 19:26:20 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:21 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb" returned: 0 in 0.374s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Path /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:21 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 Sep 28 19:26:21 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:21 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c" returned: 0 in 0.387s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38b4e870-8343-4d88-850f-4fb026efc213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0d2829-f3bd-4aa0-905c-f38781c9767b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:21 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 Sep 28 19:26:21 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:21 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213" returned: 0 in 0.504s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:21 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c Sep 28 19:26:21 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:22 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c" returned: 0 in 0.676s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:22 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c Sep 28 19:26:22 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:22 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213.faee19b3-0d3f-4b0b-8b25-7782b8fc743c" returned: 0 in 0.370s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-faee19b3-0d3f-4b0b-8b25-7782b8fc743c" released by "_delete_snapshot" :: held 2.081s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-38b4e870-8343-4d88-850f-4fb026efc213" released by "delete_snapshot" :: held 2.110s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:22 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Created reservations ['598be9f1-3039-4411-8623-1c2994e274ea', '76d5fc91-aaa9-48b5-b5fa-3efd0e1330e4', '6dea920c-33c4-4312-bc47-079ee4d554d2', '4b99b9be-bea4-4c45-aa0a-f293fb27f795'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Delete snapshot completed successfully. Sep 28 19:26:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a05351e0-0506-4879-8ed7-852464d1e47b tempest-ProjectMemberTests-2079916226 None] Lock "cinder-faee19b3-0d3f-4b0b-8b25-7782b8fc743c-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-38b4e870-8343-4d88-850f-4fb026efc213-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-38b4e870-8343-4d88-850f-4fb026efc213-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-38b4e870-8343-4d88-850f-4fb026efc213" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-38b4e870-8343-4d88-850f-4fb026efc213" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:24 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5a7e28-8167-4908-bd80-56b2c4dc49ab]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:24 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 Sep 28 19:26:24 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:25 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213" returned: 0 in 0.800s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:25 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213 Sep 28 19:26:25 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:25 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-38b4e870-8343-4d88-850f-4fb026efc213" returned: 0 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-38b4e870-8343-4d88-850f-4fb026efc213" released by "delete_volume" :: held 1.364s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Created reservations ['17e63327-0283-4c9c-b471-4956e665fe6c', '72dc3b7f-764d-4689-8ec5-9633c71b881c', '8f475c6b-9e5c-468c-99a3-2bdfb4b3b94e', '0da025f2-9ec5-4646-a6d6-91bc29953ddc'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:26 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:26 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:26 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.578s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:26 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Deleted volume successfully. Sep 28 19:26:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48a47b0b-9d66-43d8-96ef-64135b806d27 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-38b4e870-8343-4d88-850f-4fb026efc213-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (3407c3ec-67e8-40af-a0be-6b78b07d385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd35fb3-3e76-496c-898a-45350ebe4a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd35fb3-3e76-496c-898a-45350ebe4a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398454477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5eee73-fbf0-47d5-8449-d9ebdb0509fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:27Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684fc09f-2db1-42d3-8ad7-4c63f6f9fc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684fc09f-2db1-42d3-8ad7-4c63f6f9fc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c176c4dd-3d25-426d-a1a7-46b1c7412a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c176c4dd-3d25-426d-a1a7-46b1c7412a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5eee73-fbf0-47d5-8449-d9ebdb0509fc', 'volume_name': 'volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e733d6a-343b-41d4-9f67-a01310d4a395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e733d6a-343b-41d4-9f67-a01310d4a395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d7458d-9b7f-49e0-babd-e30d943944d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Volume 1e5eee73-fbf0-47d5-8449-d9ebdb0509fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc', 'volume_size': 1} Sep 28 19:26:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:28 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325" returned: 0 in 7.400s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Image conversion details: src /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb, size 1024.00 MB, duration 7.40 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:26:28 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Converted 1024.00 MB image at 138.35 MB/s Sep 28 19:26:28 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 is being set with open permissions: ugo+rw Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:28 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 Sep 28 19:26:28 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:28 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-95237930-8e88-4417-9599-4722fea47325" released by "_copy_volume_from_snapshot" :: held 8.554s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-89e53d38-9299-462b-9210-3a5eca681661-95237930-8e88-4417-9599-4722fea47325" released by "_create_volume_from_snapshot" :: held 8.629s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.655s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.252s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f446165-180a-49d5-b343-a21034c2a456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384d402c1ebb47abba22a3c00ca30caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:17Z,use_quota=True,user_id='67e920a836e14dd29c4f30508f5a846f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Creating volume 7f446165-180a-49d5-b343-a21034c2a456 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:26:28 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:28 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 1073741824 Sep 28 19:26:28 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c316e58-1ba7-4600-9597-24b62e41d3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95237930-8e88-4417-9599-4722fea47325', 'volume_size': 1, 'snapshot_id': '89e53d38-9299-462b-9210-3a5eca681661'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda6ece8-a2b7-4c31-ac8b-95353e3bdde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Volume volume-95237930-8e88-4417-9599-4722fea47325 (95237930-8e88-4417-9599-4722fea47325): created successfully Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda6ece8-a2b7-4c31-ac8b-95353e3bdde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Flow 'volume_create_manager' (45be63f4-2aab-4f32-b4f3-798868148948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ac853910-4854-4204-855c-bde7076ce86f tempest-SnapshotDependencyTests-670949352 None] Created volume successfully. Sep 28 19:26:29 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 1073741824" returned: 0 in 0.446s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:29 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 Sep 28 19:26:29 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:29 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456" returned: 0 in 0.282s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.745s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1804678420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a7f497-4fbb-4733-9026-a8c94a1b6daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae8c6142f104bb3a2a30761b297bcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:20Z,use_quota=True,user_id='f202ce09532f4448a6bda483e5a032f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Creating volume 05a7f497-4fbb-4733-9026-a8c94a1b6daa {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:26:29 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:29 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa 1073741824 Sep 28 19:26:29 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "cinder-89e53d38-9299-462b-9210-3a5eca681661-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Attempting download of 6990deb9-76cf-4031-82d9-5706b3e61b6e ((None, [{'url': 'file:///opt/stack/data/glance/images/6990deb9-76cf-4031-82d9-5706b3e61b6e', 'metadata': {}}])) to volume 7f446165-180a-49d5-b343-a21034c2a456. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-89e53d38-9299-462b-9210-3a5eca681661-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "cinder-quobyte-97dd4bf8-26e0-451d-be93-a4c52bb392fb" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-97dd4bf8-26e0-451d-be93-a4c52bb392fb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "cinder-quobyte-89e53d38-9299-462b-9210-3a5eca681661" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-89e53d38-9299-462b-9210-3a5eca681661" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Deleting offline snapshot 89e53d38-9299-462b-9210-3a5eca681661 of volume 97dd4bf8-26e0-451d-be93-a4c52bb392fb {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] snapshot_file for this snap is: volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[438d32b0-b478-4c1e-8b81-0ba2cd073c32]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b375040-e16b-4eef-9743-75187505dfe3]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6990deb9-76cf-4031-82d9-5706b3e61b6e_rq0jvcl6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:29 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 Sep 28 19:26:29 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:29 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6990deb9-76cf-4031-82d9-5706b3e61b6e_rq0jvcl6 Sep 28 19:26:29 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:30 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa 1073741824" returned: 0 in 0.511s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:30 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6990deb9-76cf-4031-82d9-5706b3e61b6e_rq0jvcl6" returned: 0 in 0.366s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6990deb9-76cf-4031-82d9-5706b3e61b6e_rq0jvcl6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:30 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661" returned: 0 in 0.434s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:26:30 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa Sep 28 19:26:30 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e8832-90fc-4a1d-9158-11355668f097]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:30 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6990deb9-76cf-4031-82d9-5706b3e61b6e_rq0jvcl6 Sep 28 19:26:30 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:30 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb Sep 28 19:26:30 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:30 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa" returned: 0 in 0.270s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.909s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398454477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5eee73-fbf0-47d5-8449-d9ebdb0509fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:27Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Creating volume 1e5eee73-fbf0-47d5-8449-d9ebdb0509fc {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:26:30 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:30 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6990deb9-76cf-4031-82d9-5706b3e61b6e_rq0jvcl6" returned: 1 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6990deb9-76cf-4031-82d9-5706b3e61b6e_rq0jvcl6' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d632acd4-9bba-4a40-bd20-bb5bc024d158]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:30 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc 1073741824 Sep 28 19:26:30 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16f2fce-ed93-4186-828b-8e9ac881f4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4a0737-ba83-4e20-814f-8c2b5595dd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:30 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Volume volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa (05a7f497-4fbb-4733-9026-a8c94a1b6daa): created successfully Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4a0737-ba83-4e20-814f-8c2b5595dd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Flow 'volume_create_manager' (c16458ed-8807-4665-821d-b77c1a26820c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2131d26c-f31b-4d92-bcc7-996ab90d1331 tempest-CinderUnicodeTest-841031656 None] Created volume successfully. Sep 28 19:26:30 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD Sep 28 19:26:30 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:30 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb" returned: 0 in 0.616s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:30 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 Sep 28 19:26:30 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:31 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:31 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc 1073741824" returned: 0 in 0.669s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:31 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD Sep 28 19:26:31 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:31 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc Sep 28 19:26:31 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:31 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661" returned: 0 in 0.492s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:31 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661 Sep 28 19:26:31 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:31 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] 6990deb9-76cf-4031-82d9-5706b3e61b6e was raw, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:31 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" returned: 0 in 0.290s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.257s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:31 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 Sep 28 19:26:31 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d7458d-9b7f-49e0-babd-e30d943944d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a44b24-3c80-44a8-a807-d6393410c662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Creating offline snapshot 9c0fecea-fc6a-40d7-94c2-ea528ce1f8de of volume 05a7f497-4fbb-4733-9026-a8c94a1b6daa {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:26:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Volume volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc (1e5eee73-fbf0-47d5-8449-d9ebdb0509fc): created successfully Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a44b24-3c80-44a8-a807-d6393410c662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (3407c3ec-67e8-40af-a0be-6b78b07d385e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eaeece-3f41-46c0-85d4-d1e60db58230]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fab73050-6f03-420c-8747-d83e916be86c tempest-ProjectMemberTests-2079916226 None] Created volume successfully. Sep 28 19:26:31 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb.89e53d38-9299-462b-9210-3a5eca681661" returned: 0 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:31 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa Sep 28 19:26:31 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-89e53d38-9299-462b-9210-3a5eca681661" released by "_delete_snapshot" :: held 2.036s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-97dd4bf8-26e0-451d-be93-a4c52bb392fb" released by "delete_snapshot" :: held 2.068s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Created reservations ['338c28f9-1e18-4f85-95fe-2d861fec4494', 'a7571262-386b-4931-81cb-8abf7cf3c3dc', 'afac75f2-862b-44fc-9e66-2927f4230bc2', '1aa70c88-ebb1-4a99-a4e3-c5ca193cecdd'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Delete snapshot completed successfully. Sep 28 19:26:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c245238e-7482-477c-adfe-a36ff46eb80b tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-89e53d38-9299-462b-9210-3a5eca681661-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:32 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:32 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456" returned: 0 in 0.618s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6990deb9-76cf-4031-82d9-5706b3e61b6e_bblbt5cmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 19:26:32 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:32 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de 1G Sep 28 19:26:32 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:32 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 1G Sep 28 19:26:32 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:32 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 1G" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Downloaded image 6990deb9-76cf-4031-82d9-5706b3e61b6e ((None, [{'url': 'file:///opt/stack/data/glance/images/6990deb9-76cf-4031-82d9-5706b3e61b6e', 'metadata': {}}])) to volume 7f446165-180a-49d5-b343-a21034c2a456 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Temporary image 6990deb9-76cf-4031-82d9-5706b3e61b6e for user 67e920a836e14dd29c4f30508f5a846f is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Marking volume 7f446165-180a-49d5-b343-a21034c2a456 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Copying metadata from image 6990deb9-76cf-4031-82d9-5706b3e61b6e to 7f446165-180a-49d5-b343-a21034c2a456. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Creating volume glance metadata for volume 7f446165-180a-49d5-b343-a21034c2a456 backed by image 6990deb9-76cf-4031-82d9-5706b3e61b6e with: {'image_id': '6990deb9-76cf-4031-82d9-5706b3e61b6e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'bc8637f814fc49ad80cd9d95efaeca17', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 19:26:32 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de 1G" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fdc235-c9d4-431a-8d2f-4ef6d29402c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f446165-180a-49d5-b343-a21034c2a456', 'volume_size': 1, 'image_id': '6990deb9-76cf-4031-82d9-5706b3e61b6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6990deb9-76cf-4031-82d9-5706b3e61b6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc8637f814fc49ad80cd9d95efaeca17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '384d402c1ebb47abba22a3c00ca30caa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '452290472a8771d6efd29c6efbed1a3b8d35b4561755f4eb93dffda808c9830f4e9e8a037e64869ff5e277fc210d7a585ae306047cb88b7e5e4d42fe200db012', 'id': '6990deb9-76cf-4031-82d9-5706b3e61b6e', 'created_at': datetime.datetime(2026, 9, 28, 17, 26, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 17, 26, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6990deb9-76cf-4031-82d9-5706b3e61b6e/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12427196-80a5-4707-b3f0-0d0c588e431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:32 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de Sep 28 19:26:32 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Volume volume-7f446165-180a-49d5-b343-a21034c2a456 (7f446165-180a-49d5-b343-a21034c2a456): created successfully Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12427196-80a5-4707-b3f0-0d0c588e431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Flow 'volume_create_manager' (aa9d9e6a-815f-4df4-9cf4-250e84a1e01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6d8b896c-0fa0-407a-b28f-2f96747e40b1 tempest-VolumeImageDependencyTests-553174916 None] Created volume successfully. Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Acquiring lock "cinder-7f446165-180a-49d5-b343-a21034c2a456-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:32 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Lock "cinder-7f446165-180a-49d5-b343-a21034c2a456-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de" returned: 0 in 0.355s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:32 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de is being set with open permissions: ugo+rw Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:32 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de Sep 28 19:26:32 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Acquiring lock "cinder-quobyte-7f446165-180a-49d5-b343-a21034c2a456" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "cinder-97dd4bf8-26e0-451d-be93-a4c52bb392fb-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Lock "cinder-quobyte-7f446165-180a-49d5-b343-a21034c2a456" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-97dd4bf8-26e0-451d-be93-a4c52bb392fb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e92eb7-17aa-4a45-bbd0-bde246c047e9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "cinder-quobyte-97dd4bf8-26e0-451d-be93-a4c52bb392fb" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-97dd4bf8-26e0-451d-be93-a4c52bb392fb" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[913699b8-cd4d-4ffe-bab3-b98e840713cf]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:33 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 Sep 28 19:26:33 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:33 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de" returned: 0 in 0.386s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:33 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb Sep 28 19:26:33 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:33 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.info Sep 28 19:26:33 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:33 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456" returned: 0 in 0.456s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:33 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456 Sep 28 19:26:33 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:33 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.info" returned: 0 in 0.270s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:33 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.info is being set with open permissions: ugo+rw Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:33 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb" returned: 0 in 0.425s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:33 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.info Sep 28 19:26:33 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:33 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb Sep 28 19:26:33 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:33 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-7f446165-180a-49d5-b343-a21034c2a456" returned: 0 in 0.298s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Lock "cinder-quobyte-7f446165-180a-49d5-b343-a21034c2a456" released by "delete_volume" :: held 0.823s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:33 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-97dd4bf8-26e0-451d-be93-a4c52bb392fb" returned: 0 in 0.270s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:33 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.info" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-97dd4bf8-26e0-451d-be93-a4c52bb392fb" released by "delete_volume" :: held 0.786s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.986s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:33 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Created reservations ['f73f88b7-082c-4a2c-9356-2215d17db5e1', 'eabe5af8-5456-4962-ac74-161c2e6858b5', 'caf4ca16-96e5-49ec-81a2-9faa197ce93c', '48934cae-e40f-405a-94bd-70bd52131dab'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-67a21241-f165-4735-a8d5-91dda791bda2 tempest-CinderUnicodeTest-841031656 None] Create snapshot completed successfully Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Creating offline snapshot cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 of volume 1e5eee73-fbf0-47d5-8449-d9ebdb0509fc {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc79994-3bcc-479d-b8df-5874b7beffd8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Created reservations ['13fc28d9-59ed-492f-b99d-18055f4f0cbe', '2bd9e11d-2140-426f-9702-f8b9888e0e65', '4e229251-30d1-47b6-8cd7-ca1371b9ab09', '255a94a5-da9a-4670-884d-c93cac89b7bc'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:34 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:34 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:34 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc Sep 28 19:26:34 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:34 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:34 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Acquiring lock "cinder-9c0fecea-fc6a-40d7-94c2-ea528ce1f8de-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Lock "cinder-9c0fecea-fc6a-40d7-94c2-ea528ce1f8de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Acquiring lock "cinder-quobyte-05a7f497-4fbb-4733-9026-a8c94a1b6daa" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Lock "cinder-quobyte-05a7f497-4fbb-4733-9026-a8c94a1b6daa" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Acquiring lock "cinder-quobyte-9c0fecea-fc6a-40d7-94c2-ea528ce1f8de" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Lock "cinder-quobyte-9c0fecea-fc6a-40d7-94c2-ea528ce1f8de" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Deleting offline snapshot 9c0fecea-fc6a-40d7-94c2-ea528ce1f8de of volume 05a7f497-4fbb-4733-9026-a8c94a1b6daa {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:26:34 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] snapshot_file for this snap is: volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Deleted volume successfully. Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4eae1c-c036-4b9c-a64c-f622548de6a4]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:34 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" returned: 0 in 0.505s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:34 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a3c96453-1396-4f48-a2c0-94311d72df46 tempest-VolumeImageDependencyTests-553174916 None] Lock "cinder-7f446165-180a-49d5-b343-a21034c2a456-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:34 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 1G Sep 28 19:26:34 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Deleted volume successfully. Sep 28 19:26:34 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:34 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0f983e40-4706-402b-b43e-17ea2d059d5e tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-97dd4bf8-26e0-451d-be93-a4c52bb392fb-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:34 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de Sep 28 19:26:34 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:34 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:26:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:26:35 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de" returned: 0 in 0.455s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[879f544f-78d3-40fd-9122-fc7d4dc6eada]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:35 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 1G" returned: 0 in 0.622s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:35 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa Sep 28 19:26:35 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:35 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 Sep 28 19:26:35 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "cinder-95237930-8e88-4417-9599-4722fea47325-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-95237930-8e88-4417-9599-4722fea47325-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "cinder-quobyte-95237930-8e88-4417-9599-4722fea47325" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-95237930-8e88-4417-9599-4722fea47325" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5171cb87-d946-4908-9be8-094b960759a9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:35 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa" returned: 0 in 0.552s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:35 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:35 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 is being set with open permissions: ugo+rw Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:35 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 Sep 28 19:26:35 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:35 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de Sep 28 19:26:35 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:35 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 Sep 28 19:26:35 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:35 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7" returned: 0 in 0.331s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:35 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325" returned: 0 in 0.507s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:36 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325 Sep 28 19:26:36 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:36 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.info Sep 28 19:26:36 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:36 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de" returned: 0 in 0.502s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:36 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de Sep 28 19:26:36 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:36 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-95237930-8e88-4417-9599-4722fea47325" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-quobyte-95237930-8e88-4417-9599-4722fea47325" released by "delete_volume" :: held 0.950s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:36 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.info" returned: 0 in 0.356s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:36 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.info is being set with open permissions: ugo+rw Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:36 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.info Sep 28 19:26:36 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Created reservations ['7b61e784-f5bf-4b23-95fe-88fa3782aed1', '63318107-076c-4d89-ab24-8de145d436ac', 'f9c47500-80ad-4f75-96ce-c6b54df12155', '202afb52-a788-4d98-9d40-6aa0546153f9'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:36 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa.9c0fecea-fc6a-40d7-94c2-ea528ce1f8de" returned: 0 in 0.439s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Lock "cinder-quobyte-9c0fecea-fc6a-40d7-94c2-ea528ce1f8de" released by "_delete_snapshot" :: held 2.118s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Lock "cinder-quobyte-05a7f497-4fbb-4733-9026-a8c94a1b6daa" released by "delete_snapshot" :: held 2.153s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:36 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.info" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:36 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:36 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Created reservations ['3971be3c-f0b0-4b50-964a-18155b4348c4', '7ada463d-8f73-4eb2-b875-35b6c25e03cb', '20cbc182-9459-410c-a921-abf717d75657', '675361e2-c6b4-4376-b819-be2807c274c7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-eee3c65e-9ef6-421e-9df8-37f33e5fe3c8 tempest-ProjectMemberTests-2079916226 None] Create snapshot completed successfully Sep 28 19:26:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Delete snapshot completed successfully. Sep 28 19:26:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e656a673-9228-4fb8-bb20-f56b2bdd9747 tempest-CinderUnicodeTest-841031656 None] Lock "cinder-9c0fecea-fc6a-40d7-94c2-ea528ce1f8de-delete_snapshot" released by "delete_snapshot" :: held 2.424s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:37 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.322s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Deleted volume successfully. Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e180914d-d0ad-4f2c-b773-182998a4a63f tempest-SnapshotDependencyTests-670949352 None] Lock "cinder-95237930-8e88-4417-9599-4722fea47325-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Lock "cinder-cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Deleting offline snapshot cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 of volume 1e5eee73-fbf0-47d5-8449-d9ebdb0509fc {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] snapshot_file for this snap is: volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c5d6d8-a71e-47cb-b13c-fc1d795668fa]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:37 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 Sep 28 19:26:37 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Acquiring lock "cinder-05a7f497-4fbb-4733-9026-a8c94a1b6daa-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Lock "cinder-05a7f497-4fbb-4733-9026-a8c94a1b6daa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Acquiring lock "cinder-quobyte-05a7f497-4fbb-4733-9026-a8c94a1b6daa" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Lock "cinder-quobyte-05a7f497-4fbb-4733-9026-a8c94a1b6daa" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:37 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7" returned: 0 in 0.535s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c9a25a-56e1-4d40-9ce2-d5b9e910ef1d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4eed47-da2f-4d46-9bb3-199aab012153]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:38 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa Sep 28 19:26:38 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:38 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc Sep 28 19:26:38 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:38 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa" returned: 0 in 0.498s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:38 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" returned: 0 in 0.510s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:38 devstack sudo[109076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa Sep 28 19:26:38 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:38 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 Sep 28 19:26:38 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:38 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-05a7f497-4fbb-4733-9026-a8c94a1b6daa" returned: 0 in 0.425s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Lock "cinder-quobyte-05a7f497-4fbb-4733-9026-a8c94a1b6daa" released by "delete_volume" :: held 1.063s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:38 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7" returned: 0 in 0.507s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Created reservations ['809be681-2a64-4585-8bc5-71065fed3bd8', '0f6b50a4-35f2-4697-a965-bf3de1536947', 'c12b0e49-670d-42f8-9dda-04e104b3b623', 'd7ad5518-9939-4ba7-a824-60e141e1205c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:39 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7 Sep 28 19:26:39 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:39 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:39 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:39 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc.cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7" returned: 0 in 0.337s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7" released by "_delete_snapshot" :: held 2.037s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" released by "delete_snapshot" :: held 2.071s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:39 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Deleted volume successfully. Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eff85312-5842-480f-972d-566b7855e51e tempest-CinderUnicodeTest-841031656 None] Lock "cinder-05a7f497-4fbb-4733-9026-a8c94a1b6daa-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Created reservations ['25aa0b58-72e8-42fc-8437-5f0702111c7f', '60cfb71d-8fe2-41bf-820e-8aaa12b3463c', '62031ecb-77b3-441b-a51e-a0e31fcfe370', '31af8cfd-4b54-4b07-baa0-26aa48543b6d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Delete snapshot completed successfully. Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-80559fd5-cb80-4a0e-ad19-68770989755e tempest-ProjectMemberTests-2079916226 None] Lock "cinder-cd5cc2b3-6dd1-4fb3-a3d0-5fa506a291e7-delete_snapshot" released by "delete_snapshot" :: held 2.270s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e6fa663d-dfc6-445a-8985-92a1cee7b98d tempest-ProjectAdminTests-1697581969 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0996932983398, 'free_capacity_gb': 1775.0996932983398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86846) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Acquiring lock "cinder-78a7f7f6-1e84-4502-94cf-2fb986b25ff2-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Lock "cinder-78a7f7f6-1e84-4502-94cf-2fb986b25ff2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Acquiring lock "cinder-quobyte-78a7f7f6-1e84-4502-94cf-2fb986b25ff2" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Lock "cinder-quobyte-78a7f7f6-1e84-4502-94cf-2fb986b25ff2" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc8fb11-dbd5-447c-8feb-d3e6c000d432]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:40 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2 Sep 28 19:26:40 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:40 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2" returned: 0 in 0.534s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" acquired by "delete_volume" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:40 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2 Sep 28 19:26:40 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf5a633-e097-46ad-8b10-c679a5dbd560]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:41 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc Sep 28 19:26:41 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:41 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-78a7f7f6-1e84-4502-94cf-2fb986b25ff2" returned: 0 in 0.354s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Lock "cinder-quobyte-78a7f7f6-1e84-4502-94cf-2fb986b25ff2" released by "delete_volume" :: held 0.957s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Created reservations ['dbd14114-7cb7-4a41-93c6-5a46f7c529ce', 'e850d30b-dbc7-4f0e-871d-308e25598150', '3d06ac89-2ecd-42fd-bf8c-cad2030f5dbc', 'edbe78f6-6b94-4848-992e-9685d94a930a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:41 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" returned: 0 in 0.595s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:41 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:41 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:41 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc Sep 28 19:26:41 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:41 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Deleted volume successfully. Sep 28 19:26:41 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" returned: 0 in 0.356s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-481a88b6-09e1-47b5-bad6-b5e49d0e2fbe tempest-CinderUnicodeTest-841031656 None] Lock "cinder-78a7f7f6-1e84-4502-94cf-2fb986b25ff2-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc" released by "delete_volume" :: held 1.074s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Created reservations ['974c54bb-ad69-4503-8e6b-0a445c4f10e9', '39a14bcf-c16b-4a62-90de-15b1db5813fa', '6f737617-c0b8-4a76-a863-4aa170d1331f', '818260fa-fd4f-4502-8404-45810a49660a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:42 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:42 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:42 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.290s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:42 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Deleted volume successfully. Sep 28 19:26:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a261b766-8608-4941-af30-eab4b2aed2e3 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-1e5eee73-fbf0-47d5-8449-d9ebdb0509fc-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (0184e796-ed15-4640-8123-6719844f546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165cd47e-035e-40b5-9501-20d26b94f319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165cd47e-035e-40b5-9501-20d26b94f319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769890275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba728a4f-8bb1-467e-9faf-9044e3111dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:44Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b86d38-22cf-4750-bd50-73854d32ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b86d38-22cf-4750-bd50-73854d32ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab51bf1-9daf-439f-a97a-72e4aa13133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab51bf1-9daf-439f-a97a-72e4aa13133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba728a4f-8bb1-467e-9faf-9044e3111dc4', 'volume_name': 'volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecdec94-d753-4bae-97a4-5982bfe59615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecdec94-d753-4bae-97a4-5982bfe59615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec7786e-247f-407b-b191-0fa4fb3e2db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Volume ba728a4f-8bb1-467e-9faf-9044e3111dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4', 'volume_size': 1} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769890275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba728a4f-8bb1-467e-9faf-9044e3111dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:44Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Creating volume ba728a4f-8bb1-467e-9faf-9044e3111dc4 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:26:43 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:26:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:44 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 1073741824 Sep 28 19:26:44 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:44 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 1073741824" returned: 0 in 0.738s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:44 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 Sep 28 19:26:44 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:45 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4" returned: 0 in 0.333s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:26:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec7786e-247f-407b-b191-0fa4fb3e2db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223689ba-93d5-4878-a5b8-f99d6684ffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Volume volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 (ba728a4f-8bb1-467e-9faf-9044e3111dc4): created successfully Sep 28 19:26:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223689ba-93d5-4878-a5b8-f99d6684ffc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (0184e796-ed15-4640-8123-6719844f546f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d14cb4a6-a4de-4921-92f6-501f07e030cb tempest-ProjectMemberTests-2079916226 None] Created volume successfully. Sep 28 19:26:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Creating offline snapshot de0406f9-ab9e-4787-9d71-ac436ec4c185 of volume ba728a4f-8bb1-467e-9faf-9044e3111dc4 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:26:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[91595dc1-3dbf-4610-a249-6e61d36223a5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:46 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 Sep 28 19:26:46 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:46 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4" returned: 0 in 0.518s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:46 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 1G Sep 28 19:26:46 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:47 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 1G" returned: 0 in 0.604s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:47 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 Sep 28 19:26:47 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:47 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185" returned: 0 in 0.437s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:47 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 is being set with open permissions: ugo+rw Sep 28 19:26:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:47 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 Sep 28 19:26:47 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:48 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:48 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.info Sep 28 19:26:48 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:48 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.info" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:48 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.info is being set with open permissions: ugo+rw Sep 28 19:26:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:48 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.info Sep 28 19:26:48 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:48 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.info" returned: 0 in 0.332s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.728s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1493f321-73a6-4ec1-b731-a5ae1ed55d2f tempest-ProjectMemberTests-2079916226 None] Create snapshot completed successfully Sep 28 19:26:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-de0406f9-ab9e-4787-9d71-ac436ec4c185-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-de0406f9-ab9e-4787-9d71-ac436ec4c185-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-ba728a4f-8bb1-467e-9faf-9044e3111dc4" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-ba728a4f-8bb1-467e-9faf-9044e3111dc4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-de0406f9-ab9e-4787-9d71-ac436ec4c185" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-de0406f9-ab9e-4787-9d71-ac436ec4c185" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Deleting offline snapshot de0406f9-ab9e-4787-9d71-ac436ec4c185 of volume ba728a4f-8bb1-467e-9faf-9044e3111dc4 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:26:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] snapshot_file for this snap is: volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:26:49 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[795407f4-c456-4abe-9ddd-73097f3ad03c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:49 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 Sep 28 19:26:49 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:50 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185" returned: 0 in 0.557s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:26:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[964b2486-f8fa-4f12-abb2-5c6a528b032c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:50 devstack sudo[109156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 Sep 28 19:26:50 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:50 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4" returned: 0 in 0.563s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:50 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 Sep 28 19:26:50 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:51 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185" returned: 0 in 0.441s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:51 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185 Sep 28 19:26:51 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:51 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4.de0406f9-ab9e-4787-9d71-ac436ec4c185" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-de0406f9-ab9e-4787-9d71-ac436ec4c185" released by "_delete_snapshot" :: held 2.065s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-ba728a4f-8bb1-467e-9faf-9044e3111dc4" released by "delete_snapshot" :: held 2.105s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:51 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=214,cinder:DELETE=15,cinder:SELECT=160,cinder:INSERT=67 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:26:51 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=224,cinder:SELECT=174,cinder:INSERT=55,cinder:DELETE=19 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:26:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Created reservations ['91a8fd3b-15cc-4be7-a24d-3bc7cddb5228', 'ace5872c-6f5d-48a4-8f72-4c8c8ac2d79e', '4355d998-fcd4-4c88-a527-bc00712ef7e6', 'ede2af49-ebe6-4fa5-ba36-25e1629ea91c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Delete snapshot completed successfully. Sep 28 19:26:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0cdc6871-3657-43cd-a391-c0db16fe4a31 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-de0406f9-ab9e-4787-9d71-ac436ec4c185-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-ba728a4f-8bb1-467e-9faf-9044e3111dc4-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-ba728a4f-8bb1-467e-9faf-9044e3111dc4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-ba728a4f-8bb1-467e-9faf-9044e3111dc4" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:26:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-ba728a4f-8bb1-467e-9faf-9044e3111dc4" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:26:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d93785-5339-4fdd-8c56-d9acc6204894]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:53 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 Sep 28 19:26:53 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:53 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4" returned: 0 in 0.435s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:53 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4 Sep 28 19:26:53 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:53 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-ba728a4f-8bb1-467e-9faf-9044e3111dc4" returned: 0 in 0.315s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-ba728a4f-8bb1-467e-9faf-9044e3111dc4" released by "delete_volume" :: held 0.859s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Created reservations ['82d3a2cf-7c1e-46bb-b7cb-0ddef6f7ca32', 'c2727791-516c-4398-830c-efca93489314', 'eb96b217-ed28-4533-bf77-04c8187d5c59', '33ea4f49-6145-4fd9-b76f-08b74ae00bcd'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:53 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:26:53 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:54 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.315s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:26:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Deleted volume successfully. Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-13edee68-16f0-4b19-a748-84f22a507232 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-ba728a4f-8bb1-467e-9faf-9044e3111dc4-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (e56246a5-5cf5-4b99-b41e-1fd4d47101d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5cb105f-117d-4001-9c3c-3685a7a70628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5cb105f-117d-4001-9c3c-3685a7a70628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-194304989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a31a55-32ce-45fa-bcf7-a605533f590d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:55Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17041ca5-e7a2-409c-803c-be13ee47823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17041ca5-e7a2-409c-803c-be13ee47823f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c289e9b0-c1c6-41bf-b1d0-d530f7f84205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c289e9b0-c1c6-41bf-b1d0-d530f7f84205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a31a55-32ce-45fa-bcf7-a605533f590d', 'volume_name': 'volume-a5a31a55-32ce-45fa-bcf7-a605533f590d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5380f836-9e4c-48f3-811e-3b4360458742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5380f836-9e4c-48f3-811e-3b4360458742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a0c89b-1dcd-4fa7-8819-dc87b8101f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Volume a5a31a55-32ce-45fa-bcf7-a605533f590d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a31a55-32ce-45fa-bcf7-a605533f590d', 'volume_size': 1} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-194304989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a31a55-32ce-45fa-bcf7-a605533f590d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:26:55Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Creating volume a5a31a55-32ce-45fa-bcf7-a605533f590d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:26:54 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:26:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:55 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d 1073741824 Sep 28 19:26:55 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:55 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d 1073741824" returned: 0 in 0.441s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:55 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d Sep 28 19:26:55 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:55 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:26:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a0c89b-1dcd-4fa7-8819-dc87b8101f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a31a55-32ce-45fa-bcf7-a605533f590d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d01b3d-44bb-4874-bdf1-765257065bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:26:55 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Volume volume-a5a31a55-32ce-45fa-bcf7-a605533f590d (a5a31a55-32ce-45fa-bcf7-a605533f590d): created successfully Sep 28 19:26:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d01b3d-44bb-4874-bdf1-765257065bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:26:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (e56246a5-5cf5-4b99-b41e-1fd4d47101d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:26:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8678bde3-4dc8-432a-a8a7-52f7784b5195 tempest-ProjectMemberTests-2079916226 None] Created volume successfully. Sep 28 19:26:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:26:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:26:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Creating offline snapshot 60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 of volume a5a31a55-32ce-45fa-bcf7-a605533f590d {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:26:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5ff58c-4c81-4d49-9301-fe6fb160767c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:26:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:56 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d Sep 28 19:26:56 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:57 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:57 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 1G Sep 28 19:26:57 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:57 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 1G" returned: 0 in 0.540s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a31a55-32ce-45fa-bcf7-a605533f590d -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:57 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a31a55-32ce-45fa-bcf7-a605533f590d -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 Sep 28 19:26:57 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:58 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a31a55-32ce-45fa-bcf7-a605533f590d -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:58 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 is being set with open permissions: ugo+rw Sep 28 19:26:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:58 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 Sep 28 19:26:58 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:58 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3" returned: 0 in 0.311s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:58 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.info Sep 28 19:26:58 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:58 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.info" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:58 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.info is being set with open permissions: ugo+rw Sep 28 19:26:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:26:58 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.info Sep 28 19:26:58 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:26:59 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Sep 28 19:26:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.info" returned: 0 in 0.249s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:26:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:26:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-56d3cf19-bed9-40e6-8779-3ec81b435e6b tempest-ProjectMemberTests-2079916226 None] Create snapshot completed successfully Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-a5a31a55-32ce-45fa-bcf7-a605533f590d" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-a5a31a55-32ce-45fa-bcf7-a605533f590d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Deleting offline snapshot 60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 of volume a5a31a55-32ce-45fa-bcf7-a605533f590d {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] snapshot_file for this snap is: volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59fd682-a69e-416e-8970-2b48af626264]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:00 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 Sep 28 19:27:00 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:00 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3" returned: 0 in 0.419s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a31a55-32ce-45fa-bcf7-a605533f590d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4518f-1a0a-4b33-bd1c-9fc632e6b0bb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:00 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d Sep 28 19:27:00 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:01 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d" returned: 0 in 0.436s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:01 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 Sep 28 19:27:01 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:01 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3" returned: 0 in 0.455s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:01 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3 Sep 28 19:27:01 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:01 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d.60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3" released by "_delete_snapshot" :: held 1.740s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-a5a31a55-32ce-45fa-bcf7-a605533f590d" released by "delete_snapshot" :: held 1.773s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:01 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Created reservations ['f112b5a5-f78c-4560-855c-13d06ff97fc4', '1d3a89c9-c6a1-4da2-b064-1a29be672576', '10763f06-a2f2-419a-bec3-ba56f385c14f', '776d7059-8fcf-41ce-8d9e-75d128382d27'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Delete snapshot completed successfully. Sep 28 19:27:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c4dc7699-5653-4bda-8bb5-60701bc9d722 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-60b4edfa-f17b-47c2-8bc3-7d0a91c7e4e3-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-a5a31a55-32ce-45fa-bcf7-a605533f590d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-a5a31a55-32ce-45fa-bcf7-a605533f590d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-a5a31a55-32ce-45fa-bcf7-a605533f590d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-a5a31a55-32ce-45fa-bcf7-a605533f590d" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa8db0f-968b-459a-a0bc-f111c061daac]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:02 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d Sep 28 19:27:02 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:02 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:02 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d Sep 28 19:27:02 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:03 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a5a31a55-32ce-45fa-bcf7-a605533f590d" returned: 0 in 0.265s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-a5a31a55-32ce-45fa-bcf7-a605533f590d" released by "delete_volume" :: held 0.790s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Created reservations ['032881d4-b765-4f48-9aaa-a9ac269b13ce', 'd38c07ac-e8fa-40cf-b328-daca5ee25145', 'c4417b91-add8-4c2c-95f6-8dc2b6f96ccb', '64047c45-825b-42b4-ae3c-dd20d227977d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:03 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:27:03 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:03 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:27:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Deleted volume successfully. Sep 28 19:27:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-077c0810-b5fb-4f0e-ab78-b93c89f90184 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-a5a31a55-32ce-45fa-bcf7-a605533f590d-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (41f70e07-363b-4180-9a48-11961a07ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339399f7-d880-45ac-9920-a9c41a1c9cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339399f7-d880-45ac-9920-a9c41a1c9cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952878810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f908da22-a2d7-43d9-a9a3-f8b45133276e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:04Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1665a66-acdb-4546-a0da-05860bf46dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1665a66-acdb-4546-a0da-05860bf46dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec62f3f-fa27-45df-820e-71f2460c4675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec62f3f-fa27-45df-820e-71f2460c4675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f908da22-a2d7-43d9-a9a3-f8b45133276e', 'volume_name': 'volume-f908da22-a2d7-43d9-a9a3-f8b45133276e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f57286-1f77-4f04-8556-db9a3c2c06d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f57286-1f77-4f04-8556-db9a3c2c06d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b897c6b3-34ab-43ea-b7eb-01fc011da0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Volume f908da22-a2d7-43d9-a9a3-f8b45133276e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f908da22-a2d7-43d9-a9a3-f8b45133276e', 'volume_size': 1} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952878810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f908da22-a2d7-43d9-a9a3-f8b45133276e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c75890dc3234ffda74fda4bd67f475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:04Z,use_quota=True,user_id='200bae42a8ee405c84ad937af23fe608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Creating volume f908da22-a2d7-43d9-a9a3-f8b45133276e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:27:04 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:04 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e 1073741824 Sep 28 19:27:04 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:04 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e 1073741824" returned: 0 in 0.564s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:04 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e Sep 28 19:27:04 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:05 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e" returned: 0 in 0.268s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:27:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b897c6b3-34ab-43ea-b7eb-01fc011da0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f908da22-a2d7-43d9-a9a3-f8b45133276e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4630b5f-43f4-4f71-83f6-9714ee145cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Volume volume-f908da22-a2d7-43d9-a9a3-f8b45133276e (f908da22-a2d7-43d9-a9a3-f8b45133276e): created successfully Sep 28 19:27:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4630b5f-43f4-4f71-83f6-9714ee145cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Flow 'volume_create_manager' (41f70e07-363b-4180-9a48-11961a07ff58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c42b1bba-d561-4d9a-94cf-7503b33b8c80 tempest-ProjectMemberTests-2079916226 None] Created volume successfully. Sep 28 19:27:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Creating offline snapshot fd401676-1cc6-48f9-9faa-f70caf4f7445 of volume f908da22-a2d7-43d9-a9a3-f8b45133276e {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:27:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa00fde-9a75-4c18-82e6-e41656d99ce4]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:06 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e Sep 28 19:27:06 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:06 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e" returned: 0 in 0.481s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:06 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 1G Sep 28 19:27:06 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:07 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 1G" returned: 0 in 0.496s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f908da22-a2d7-43d9-a9a3-f8b45133276e -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:07 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f908da22-a2d7-43d9-a9a3-f8b45133276e -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 Sep 28 19:27:07 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:07 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f908da22-a2d7-43d9-a9a3-f8b45133276e -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:07 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 is being set with open permissions: ugo+rw Sep 28 19:27:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:07 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 Sep 28 19:27:07 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:08 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:08 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.info Sep 28 19:27:08 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:08 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.info" returned: 0 in 0.258s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:08 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.info is being set with open permissions: ugo+rw Sep 28 19:27:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:08 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.info Sep 28 19:27:08 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:08 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.info" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3ec76fc1-a04d-4fb1-99e4-f2bfb9e577db tempest-ProjectMemberTests-2079916226 None] Create snapshot completed successfully Sep 28 19:27:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-fd401676-1cc6-48f9-9faa-f70caf4f7445-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-fd401676-1cc6-48f9-9faa-f70caf4f7445-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-f908da22-a2d7-43d9-a9a3-f8b45133276e" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-f908da22-a2d7-43d9-a9a3-f8b45133276e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-fd401676-1cc6-48f9-9faa-f70caf4f7445" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-fd401676-1cc6-48f9-9faa-f70caf4f7445" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Deleting offline snapshot fd401676-1cc6-48f9-9faa-f70caf4f7445 of volume f908da22-a2d7-43d9-a9a3-f8b45133276e {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:27:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] snapshot_file for this snap is: volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:27:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[914a7bf1-98a9-4516-aac7-72e4c0cc129a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:09 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 Sep 28 19:27:09 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:10 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445" returned: 0 in 0.360s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f908da22-a2d7-43d9-a9a3-f8b45133276e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:27:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[30413784-f437-40a1-a22e-6d87adcdb422]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:10 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e Sep 28 19:27:10 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:10 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:10 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 Sep 28 19:27:10 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:10 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445" returned: 0 in 0.331s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:10 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445 Sep 28 19:27:10 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:11 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e.fd401676-1cc6-48f9-9faa-f70caf4f7445" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-fd401676-1cc6-48f9-9faa-f70caf4f7445" released by "_delete_snapshot" :: held 1.401s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-f908da22-a2d7-43d9-a9a3-f8b45133276e" released by "delete_snapshot" :: held 1.431s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Created reservations ['8211848c-ecc1-4609-a521-f1c1ca8fd3d1', '01b4086d-2ba0-4f50-b1ff-a1d82c26c133', 'e1eef0e5-2fc2-4ec6-8cf5-525a12346f2c', '32af4387-bff1-4ce7-9ece-70e15d7efce1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Delete snapshot completed successfully. Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-310ed2fd-00f2-43e4-8841-4b4d77b4d619 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-fd401676-1cc6-48f9-9faa-f70caf4f7445-delete_snapshot" released by "delete_snapshot" :: held 1.573s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-f908da22-a2d7-43d9-a9a3-f8b45133276e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-f908da22-a2d7-43d9-a9a3-f8b45133276e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "cinder-quobyte-f908da22-a2d7-43d9-a9a3-f8b45133276e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-f908da22-a2d7-43d9-a9a3-f8b45133276e" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[015a2d6f-95c7-4e77-b104-204f175f5c68]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:12 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e Sep 28 19:27:12 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:12 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e" returned: 0 in 0.354s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:12 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e Sep 28 19:27:12 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:12 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-f908da22-a2d7-43d9-a9a3-f8b45133276e" returned: 0 in 0.251s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-quobyte-f908da22-a2d7-43d9-a9a3-f8b45133276e" released by "delete_volume" :: held 0.666s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Created reservations ['45792e84-6393-4056-95c9-7e66921ad1a8', '0b140a5d-3ffb-41a7-9571-0eb6a2ef99cb', 'eb40aa55-cf8d-44da-b89b-59ec186d4797', 'f149d523-9e6c-452e-acef-36d592de73fe'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:12 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:27:12 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:12 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:27:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Deleted volume successfully. Sep 28 19:27:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-247b4b9e-c886-415e-8436-040faab71ed1 tempest-ProjectMemberTests-2079916226 None] Lock "cinder-f908da22-a2d7-43d9-a9a3-f8b45133276e-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Flow 'volume_create_manager' (2ac02cae-c613-4cf6-a63f-87189535b1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a634847e-85f7-499e-8167-542a632f3bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a634847e-85f7-499e-8167-542a632f3bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779738269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3213fc-1ad3-4a2f-948b-45ec976ac1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fbbf81f1f450792f917a74a4a1ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:17Z,use_quota=True,user_id='dece7269b44d4b8e9bc5b8492cd49148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84fdb0d-746b-481b-a86d-1823898fd49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84fdb0d-746b-481b-a86d-1823898fd49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb3a47-64a1-4dad-b90c-c51fa7834576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb3a47-64a1-4dad-b90c-c51fa7834576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3213fc-1ad3-4a2f-948b-45ec976ac1e8', 'volume_name': 'volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8470641b-94c0-483d-a3ed-8f976b995c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8470641b-94c0-483d-a3ed-8f976b995c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ca54d6-5181-43fb-b75b-41a494d06190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Volume 9c3213fc-1ad3-4a2f-948b-45ec976ac1e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8', 'volume_size': 1} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779738269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3213fc-1ad3-4a2f-948b-45ec976ac1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fbbf81f1f450792f917a74a4a1ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:17Z,use_quota=True,user_id='dece7269b44d4b8e9bc5b8492cd49148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Creating volume 9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:27:16 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:27:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:16 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 1073741824 Sep 28 19:27:16 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:17 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 1073741824" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:17 devstack sudo[109324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 Sep 28 19:27:17 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:17 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" returned: 0 in 0.244s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ca54d6-5181-43fb-b75b-41a494d06190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18441adb-fb1e-461c-a2ba-5340f4b59cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:17 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Volume volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 (9c3213fc-1ad3-4a2f-948b-45ec976ac1e8): created successfully Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18441adb-fb1e-461c-a2ba-5340f4b59cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Flow 'volume_create_manager' (2ac02cae-c613-4cf6-a63f-87189535b1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1e64b3a1-5404-4426-817d-24e8e7de1261 tempest-ProjectReaderTests-657341730 None] Created volume successfully. Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Creating offline snapshot b023aaed-3df8-4f09-9de5-f1011d178864 of volume 9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad6ebf8-d801-439b-af3d-0e0d1e7002f7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:17 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 Sep 28 19:27:17 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:18 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:18 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 1G Sep 28 19:27:18 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:18 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 1G" returned: 0 in 0.377s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:18 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 Sep 28 19:27:18 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:18 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864" returned: 0 in 0.298s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:18 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 is being set with open permissions: ugo+rw Sep 28 19:27:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:18 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 Sep 28 19:27:18 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:19 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:19 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.info Sep 28 19:27:19 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:19 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.info" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:19 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.info is being set with open permissions: ugo+rw Sep 28 19:27:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:19 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.info Sep 28 19:27:19 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:19 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.info" returned: 0 in 0.244s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-928e4f65-670d-4f09-a04b-1d6c79c2e505 tempest-ProjectReaderTests-657341730 None] Create snapshot completed successfully Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-b023aaed-3df8-4f09-9de5-f1011d178864-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Lock "cinder-b023aaed-3df8-4f09-9de5-f1011d178864-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-b023aaed-3df8-4f09-9de5-f1011d178864" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-b023aaed-3df8-4f09-9de5-f1011d178864" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Deleting offline snapshot b023aaed-3df8-4f09-9de5-f1011d178864 of volume 9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] snapshot_file for this snap is: volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b174718b-15d4-4784-8b40-6329d3e1affc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:20 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 Sep 28 19:27:20 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:20 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864" returned: 0 in 0.377s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[36de8247-1016-422c-951b-8744a58dd422]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:20 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 Sep 28 19:27:20 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:20 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" returned: 0 in 0.371s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:20 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 Sep 28 19:27:20 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:21 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:21 devstack sudo[109367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864 Sep 28 19:27:21 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:21 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8.b023aaed-3df8-4f09-9de5-f1011d178864" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-b023aaed-3df8-4f09-9de5-f1011d178864" released by "_delete_snapshot" :: held 1.421s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" released by "delete_snapshot" :: held 1.446s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:21 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Created reservations ['302c3cc1-7824-499f-b6c2-abae344b3afa', 'dfdaee28-28a7-4577-87c4-cea54f2c14ae', '0cb0ed00-0049-4575-99dc-bdd7fac6a85e', 'af43a8a7-6e67-4e38-9014-4b65ba40ff17'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Delete snapshot completed successfully. Sep 28 19:27:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92fc5b2b-6fa8-4bd0-ae37-2371afac03aa tempest-ProjectReaderTests-657341730 None] Lock "cinder-b023aaed-3df8-4f09-9de5-f1011d178864-delete_snapshot" released by "delete_snapshot" :: held 1.578s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Lock "cinder-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" acquired by "delete_volume" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd140c9-ce6c-4861-ad19-b47fbdf90158]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:22 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 Sep 28 19:27:22 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:22 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:22 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8 Sep 28 19:27:22 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:22 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8" released by "delete_volume" :: held 0.670s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Created reservations ['3b5ec3fc-d27d-41bc-bf7c-5fb2155f3bfa', '6850eec7-2b4a-436e-bfe1-1063449c3246', '12e09eff-3038-48c0-8f73-86f21f7cfd5c', '1da69ee9-3182-4de8-85f9-664694e9ede4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:23 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:27:23 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:23 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:27:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Deleted volume successfully. Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2db11269-25cb-4315-8480-524fda879559 tempest-ProjectReaderTests-657341730 None] Lock "cinder-9c3213fc-1ad3-4a2f-948b-45ec976ac1e8-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Flow 'volume_create_manager' (b500c702-f5bf-460d-95bb-2870dc82a05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b77dfd5-123a-4b17-b8b5-ddb975cd741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b77dfd5-123a-4b17-b8b5-ddb975cd741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261523942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00da5af-49c0-4e5f-a471-eb5de2461092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fbbf81f1f450792f917a74a4a1ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:24Z,use_quota=True,user_id='dece7269b44d4b8e9bc5b8492cd49148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8456b68c-cec2-429b-8af6-1ee45fe6db39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8456b68c-cec2-429b-8af6-1ee45fe6db39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7fe309-33b1-4014-ba7a-2b318cafc9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7fe309-33b1-4014-ba7a-2b318cafc9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a00da5af-49c0-4e5f-a471-eb5de2461092', 'volume_name': 'volume-a00da5af-49c0-4e5f-a471-eb5de2461092', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1fcca6-8472-4f57-8f99-65b2a5e0833f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1fcca6-8472-4f57-8f99-65b2a5e0833f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9e71df-276b-4912-92f2-124d21be0238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Volume a00da5af-49c0-4e5f-a471-eb5de2461092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a00da5af-49c0-4e5f-a471-eb5de2461092', 'volume_size': 1} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261523942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00da5af-49c0-4e5f-a471-eb5de2461092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fbbf81f1f450792f917a74a4a1ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:24Z,use_quota=True,user_id='dece7269b44d4b8e9bc5b8492cd49148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Creating volume a00da5af-49c0-4e5f-a471-eb5de2461092 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:27:23 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:27:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:23 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 1073741824 Sep 28 19:27:23 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:24 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 1073741824" returned: 0 in 0.419s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:24 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 Sep 28 19:27:24 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:24 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092" returned: 0 in 0.244s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9e71df-276b-4912-92f2-124d21be0238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00da5af-49c0-4e5f-a471-eb5de2461092', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6853f9ad-b33d-48d2-b022-990a44b1f540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:24 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Volume volume-a00da5af-49c0-4e5f-a471-eb5de2461092 (a00da5af-49c0-4e5f-a471-eb5de2461092): created successfully Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6853f9ad-b33d-48d2-b022-990a44b1f540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Flow 'volume_create_manager' (b500c702-f5bf-460d-95bb-2870dc82a05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8e68f718-c3fb-400f-9aa6-4bde6d815418 tempest-ProjectReaderTests-657341730 None] Created volume successfully. Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Creating offline snapshot 0ce4e6d1-80f6-44ed-9400-e9e79cf82028 of volume a00da5af-49c0-4e5f-a471-eb5de2461092 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[271d2eef-7954-47c9-ac4c-20dd8bf94f92]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:25 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 Sep 28 19:27:25 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:25 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:25 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 1G Sep 28 19:27:25 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:25 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 1G" returned: 0 in 0.457s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a00da5af-49c0-4e5f-a471-eb5de2461092 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:25 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a00da5af-49c0-4e5f-a471-eb5de2461092 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 Sep 28 19:27:25 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:26 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a00da5af-49c0-4e5f-a471-eb5de2461092 -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028" returned: 0 in 0.299s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:26 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 is being set with open permissions: ugo+rw Sep 28 19:27:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:26 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 Sep 28 19:27:26 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:26 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028" returned: 0 in 0.246s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:26 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.info Sep 28 19:27:26 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:26 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.info" returned: 0 in 0.245s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:26 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.info is being set with open permissions: ugo+rw Sep 28 19:27:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:26 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.info Sep 28 19:27:26 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:26 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.info" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ce9241d7-24c0-45a5-a1f5-c7541b5460c3 tempest-ProjectReaderTests-657341730 None] Create snapshot completed successfully Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-0ce4e6d1-80f6-44ed-9400-e9e79cf82028-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Lock "cinder-0ce4e6d1-80f6-44ed-9400-e9e79cf82028-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-a00da5af-49c0-4e5f-a471-eb5de2461092" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-a00da5af-49c0-4e5f-a471-eb5de2461092" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-0ce4e6d1-80f6-44ed-9400-e9e79cf82028" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-0ce4e6d1-80f6-44ed-9400-e9e79cf82028" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Deleting offline snapshot 0ce4e6d1-80f6-44ed-9400-e9e79cf82028 of volume a00da5af-49c0-4e5f-a471-eb5de2461092 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] snapshot_file for this snap is: volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3810a7-d116-434a-b582-640d0fa979b6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:27 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 Sep 28 19:27:27 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:27 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028" returned: 0 in 0.367s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00da5af-49c0-4e5f-a471-eb5de2461092(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b5cbf5-c083-479e-ac6e-cda39ca1c448]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:27 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 Sep 28 19:27:27 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:27 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092" returned: 0 in 0.361s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:27 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 Sep 28 19:27:27 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:28 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028" returned: 0 in 0.323s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:28 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028 Sep 28 19:27:28 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:28 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092.0ce4e6d1-80f6-44ed-9400-e9e79cf82028" returned: 0 in 0.248s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-0ce4e6d1-80f6-44ed-9400-e9e79cf82028" released by "_delete_snapshot" :: held 1.403s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-a00da5af-49c0-4e5f-a471-eb5de2461092" released by "delete_snapshot" :: held 1.425s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:28 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Created reservations ['c727b990-0d5b-4873-a052-7125e26e99ed', '2bcfd3bb-5501-42b4-8ff3-288a7fe70286', '2835f455-9553-43bd-83ec-1ca769042204', '692f9f80-b523-4869-9a30-6c99d4eafe26'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Delete snapshot completed successfully. Sep 28 19:27:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-35dda379-4c02-42ea-b999-8eb2f7f4342e tempest-ProjectReaderTests-657341730 None] Lock "cinder-0ce4e6d1-80f6-44ed-9400-e9e79cf82028-delete_snapshot" released by "delete_snapshot" :: held 1.556s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-a00da5af-49c0-4e5f-a471-eb5de2461092-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Lock "cinder-a00da5af-49c0-4e5f-a471-eb5de2461092-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-a00da5af-49c0-4e5f-a471-eb5de2461092" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-a00da5af-49c0-4e5f-a471-eb5de2461092" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a6162a-3a04-4f6f-9967-ea70224e30e8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:29 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 Sep 28 19:27:29 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:29 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:29 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092 Sep 28 19:27:29 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:29 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a00da5af-49c0-4e5f-a471-eb5de2461092" returned: 0 in 0.239s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-a00da5af-49c0-4e5f-a471-eb5de2461092" released by "delete_volume" :: held 0.663s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:29 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Created reservations ['78907bd8-1d8f-45e4-b6b2-26e576cfcf7f', '12cef62f-0f12-4e67-8fa9-7f3aae6b3a10', '95da21c9-ae6b-41e2-9783-982c81d59776', 'bddc3035-e37b-4cac-b9b6-805f48eb91e0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:30 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:27:30 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:30 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:27:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Deleted volume successfully. Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7b5ddb34-ff18-4145-baef-9da6ab82ab1b tempest-ProjectReaderTests-657341730 None] Lock "cinder-a00da5af-49c0-4e5f-a471-eb5de2461092-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Flow 'volume_create_manager' (c3058507-43b2-4dd6-9feb-4b977441df0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d790471c-1bbe-46ca-8528-7a873aa32785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d790471c-1bbe-46ca-8528-7a873aa32785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1991607084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98017622-26ed-4ffb-bf8e-15ef81a74abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fbbf81f1f450792f917a74a4a1ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:31Z,use_quota=True,user_id='dece7269b44d4b8e9bc5b8492cd49148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bab5a7b-7b9a-4a40-adf6-aac9dbb5ebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bab5a7b-7b9a-4a40-adf6-aac9dbb5ebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c453554-8bf8-484a-bff5-2478f51445b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c453554-8bf8-484a-bff5-2478f51445b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98017622-26ed-4ffb-bf8e-15ef81a74abd', 'volume_name': 'volume-98017622-26ed-4ffb-bf8e-15ef81a74abd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6795ccf4-ad1c-4a08-981f-5de2c54ab1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6795ccf4-ad1c-4a08-981f-5de2c54ab1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc1d550-0968-4583-9d95-72460c79c366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:30 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Volume 98017622-26ed-4ffb-bf8e-15ef81a74abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98017622-26ed-4ffb-bf8e-15ef81a74abd', 'volume_size': 1} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1991607084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98017622-26ed-4ffb-bf8e-15ef81a74abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fbbf81f1f450792f917a74a4a1ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:31Z,use_quota=True,user_id='dece7269b44d4b8e9bc5b8492cd49148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Creating volume 98017622-26ed-4ffb-bf8e-15ef81a74abd {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:27:30 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:27:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:30 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd 1073741824 Sep 28 19:27:30 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:31 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd 1073741824" returned: 0 in 0.403s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:31 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd Sep 28 19:27:31 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:31 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd" returned: 0 in 0.235s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc1d550-0968-4583-9d95-72460c79c366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98017622-26ed-4ffb-bf8e-15ef81a74abd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9ba7ae-58d6-42ca-92a1-8373ccba1c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Volume volume-98017622-26ed-4ffb-bf8e-15ef81a74abd (98017622-26ed-4ffb-bf8e-15ef81a74abd): created successfully Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9ba7ae-58d6-42ca-92a1-8373ccba1c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Flow 'volume_create_manager' (c3058507-43b2-4dd6-9feb-4b977441df0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cd1ecc15-44fd-4bce-a333-ab7d94baf860 tempest-ProjectReaderTests-657341730 None] Created volume successfully. Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Creating offline snapshot 0a9510fe-5890-451f-80e0-031873671f8f of volume 98017622-26ed-4ffb-bf8e-15ef81a74abd {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dcdc2a-6b8b-4d25-a62e-7bd92be09a19]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:32 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd Sep 28 19:27:32 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:32 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd" returned: 0 in 0.353s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:32 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f 1G Sep 28 19:27:32 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:32 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f 1G" returned: 0 in 0.386s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98017622-26ed-4ffb-bf8e-15ef81a74abd -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:32 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98017622-26ed-4ffb-bf8e-15ef81a74abd -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f Sep 28 19:27:32 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:33 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98017622-26ed-4ffb-bf8e-15ef81a74abd -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:33 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f is being set with open permissions: ugo+rw Sep 28 19:27:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:33 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f Sep 28 19:27:33 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:33 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:33 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.info Sep 28 19:27:33 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:33 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.info" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:33 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.info is being set with open permissions: ugo+rw Sep 28 19:27:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:33 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.info Sep 28 19:27:33 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:33 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.info" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-89e87900-854e-47eb-8d26-db2baecff95f tempest-ProjectReaderTests-657341730 None] Create snapshot completed successfully Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-0a9510fe-5890-451f-80e0-031873671f8f-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Lock "cinder-0a9510fe-5890-451f-80e0-031873671f8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-98017622-26ed-4ffb-bf8e-15ef81a74abd" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-98017622-26ed-4ffb-bf8e-15ef81a74abd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-0a9510fe-5890-451f-80e0-031873671f8f" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-0a9510fe-5890-451f-80e0-031873671f8f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Deleting offline snapshot 0a9510fe-5890-451f-80e0-031873671f8f of volume 98017622-26ed-4ffb-bf8e-15ef81a74abd {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] snapshot_file for this snap is: volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6250ed55-a19d-481d-86ed-e5aaf3db26be]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:34 devstack sudo[109516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f Sep 28 19:27:34 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:34 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f" returned: 0 in 0.354s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98017622-26ed-4ffb-bf8e-15ef81a74abd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c208d2af-5585-496a-a358-338b4be7da2e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:34 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd Sep 28 19:27:34 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:34 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:27:34 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:34 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.246s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 19:27:34 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd" returned: 0 in 0.391s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:34 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f Sep 28 19:27:34 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:35 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:35 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f Sep 28 19:27:35 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:35 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd.0a9510fe-5890-451f-80e0-031873671f8f" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-0a9510fe-5890-451f-80e0-031873671f8f" released by "_delete_snapshot" :: held 1.439s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-98017622-26ed-4ffb-bf8e-15ef81a74abd" released by "delete_snapshot" :: held 1.462s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:35 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Created reservations ['b6d4f958-b17b-4b90-9da0-62960654aef6', '9ef16d8b-2268-4d43-81ba-5518871f05e9', 'ac394128-7e0e-49ca-be02-6ba1e2329fea', 'aadb8f5d-92d6-483a-a9b7-c6320f9f4e30'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Delete snapshot completed successfully. Sep 28 19:27:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fc4aa4c5-9144-48bc-830e-553c17904f30 tempest-ProjectReaderTests-657341730 None] Lock "cinder-0a9510fe-5890-451f-80e0-031873671f8f-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-98017622-26ed-4ffb-bf8e-15ef81a74abd-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Lock "cinder-98017622-26ed-4ffb-bf8e-15ef81a74abd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-98017622-26ed-4ffb-bf8e-15ef81a74abd" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-98017622-26ed-4ffb-bf8e-15ef81a74abd" acquired by "delete_volume" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f0fbec-2203-4552-b54c-0a468317eea8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:36 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd Sep 28 19:27:36 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:36 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd" returned: 0 in 0.371s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:36 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd Sep 28 19:27:36 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:36 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-98017622-26ed-4ffb-bf8e-15ef81a74abd" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-98017622-26ed-4ffb-bf8e-15ef81a74abd" released by "delete_volume" :: held 0.707s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Created reservations ['b9029c58-1e44-4109-a9fd-bbbd760bb877', '2d1ac7ce-8c1b-428e-b35c-41efcec012c1', 'd4f30399-513b-469f-81c0-9f244bea8721', 'e31fca99-38a3-46ec-bed9-774d2ade8cea'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:37 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:27:37 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:37 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.264s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:27:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Deleted volume successfully. Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34ba8351-9c9b-4cca-a652-78d003a86dcb tempest-ProjectReaderTests-657341730 None] Lock "cinder-98017622-26ed-4ffb-bf8e-15ef81a74abd-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Flow 'volume_create_manager' (d7d77e58-5787-4970-9213-7dd251f37d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06554b33-a29a-4e53-90f8-3e9fea1926ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06554b33-a29a-4e53-90f8-3e9fea1926ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355472658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d82d14f-7777-483b-be19-cefc669bbecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fbbf81f1f450792f917a74a4a1ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:38Z,use_quota=True,user_id='dece7269b44d4b8e9bc5b8492cd49148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d41e69-857c-49a6-b337-e1a92ceac9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d41e69-857c-49a6-b337-e1a92ceac9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c125a4-7cd0-4038-937e-b98ace1426f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c125a4-7cd0-4038-937e-b98ace1426f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d82d14f-7777-483b-be19-cefc669bbecd', 'volume_name': 'volume-9d82d14f-7777-483b-be19-cefc669bbecd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5feadc-0400-4338-96d9-7ff6c4456a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5feadc-0400-4338-96d9-7ff6c4456a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712b5afc-885b-49c0-bd56-4aa01c1d71a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Volume 9d82d14f-7777-483b-be19-cefc669bbecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d82d14f-7777-483b-be19-cefc669bbecd', 'volume_size': 1} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355472658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d82d14f-7777-483b-be19-cefc669bbecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fbbf81f1f450792f917a74a4a1ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:38Z,use_quota=True,user_id='dece7269b44d4b8e9bc5b8492cd49148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Creating volume 9d82d14f-7777-483b-be19-cefc669bbecd {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:27:37 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:27:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:38 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd 1073741824 Sep 28 19:27:38 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:38 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd 1073741824" returned: 0 in 0.423s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:38 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd Sep 28 19:27:38 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:38 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd" returned: 0 in 0.250s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:27:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712b5afc-885b-49c0-bd56-4aa01c1d71a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d82d14f-7777-483b-be19-cefc669bbecd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87de0a1-10d2-480c-b276-280ff2e9975a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Volume volume-9d82d14f-7777-483b-be19-cefc669bbecd (9d82d14f-7777-483b-be19-cefc669bbecd): created successfully Sep 28 19:27:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87de0a1-10d2-480c-b276-280ff2e9975a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Flow 'volume_create_manager' (d7d77e58-5787-4970-9213-7dd251f37d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-582582c4-d105-40a9-8062-73a2c0f81930 tempest-ProjectReaderTests-657341730 None] Created volume successfully. Sep 28 19:27:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Creating offline snapshot 991ff2b5-138a-4166-bd62-7f2e514f4818 of volume 9d82d14f-7777-483b-be19-cefc669bbecd {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:27:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1efa41-c589-40cb-8366-baf7df126221]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:39 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd Sep 28 19:27:39 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:39 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd" returned: 0 in 0.372s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:39 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 1G Sep 28 19:27:39 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:39 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 1G" returned: 0 in 0.409s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d82d14f-7777-483b-be19-cefc669bbecd -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:39 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d82d14f-7777-483b-be19-cefc669bbecd -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 Sep 28 19:27:39 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:40 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d82d14f-7777-483b-be19-cefc669bbecd -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818" returned: 0 in 0.286s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:40 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 is being set with open permissions: ugo+rw Sep 28 19:27:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:40 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 Sep 28 19:27:40 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:40 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:40 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.info Sep 28 19:27:40 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:40 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.info" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:40 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.info is being set with open permissions: ugo+rw Sep 28 19:27:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:40 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.info Sep 28 19:27:40 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:40 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.info" returned: 0 in 0.251s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9cd94287-62cc-486b-ad3b-bfd104b67ebf tempest-ProjectReaderTests-657341730 None] Create snapshot completed successfully Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-991ff2b5-138a-4166-bd62-7f2e514f4818-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Lock "cinder-991ff2b5-138a-4166-bd62-7f2e514f4818-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-9d82d14f-7777-483b-be19-cefc669bbecd" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-9d82d14f-7777-483b-be19-cefc669bbecd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-991ff2b5-138a-4166-bd62-7f2e514f4818" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-991ff2b5-138a-4166-bd62-7f2e514f4818" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Deleting offline snapshot 991ff2b5-138a-4166-bd62-7f2e514f4818 of volume 9d82d14f-7777-483b-be19-cefc669bbecd {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] snapshot_file for this snap is: volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5d1ba7-0246-4944-9e59-548f13fce273]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:41 devstack sudo[109584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 Sep 28 19:27:41 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:41 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818" returned: 0 in 0.367s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d82d14f-7777-483b-be19-cefc669bbecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d9a354-6865-4435-8b3b-b5a249f8bd70]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:41 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd Sep 28 19:27:41 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:42 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd" returned: 0 in 0.351s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:42 devstack sudo[109595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 Sep 28 19:27:42 devstack sudo[109595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:42 devstack sudo[109595]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:42 devstack sudo[109600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818 Sep 28 19:27:42 devstack sudo[109600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:42 devstack sudo[109600]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd.991ff2b5-138a-4166-bd62-7f2e514f4818" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-991ff2b5-138a-4166-bd62-7f2e514f4818" released by "_delete_snapshot" :: held 1.402s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-9d82d14f-7777-483b-be19-cefc669bbecd" released by "delete_snapshot" :: held 1.426s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:42 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Created reservations ['e3ccbc4f-99a2-4ab4-bc3c-556391db1d2e', '67eef1a3-c417-41e5-ae7f-d79296273b2f', 'a130cf49-31e9-4d3d-9722-4b516557fdff', 'a951ad73-6a98-4e26-b3a4-dc1371b4cab1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Delete snapshot completed successfully. Sep 28 19:27:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8e48ba68-567d-4d04-a960-5438c23926d6 tempest-ProjectReaderTests-657341730 None] Lock "cinder-991ff2b5-138a-4166-bd62-7f2e514f4818-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-9d82d14f-7777-483b-be19-cefc669bbecd-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Lock "cinder-9d82d14f-7777-483b-be19-cefc669bbecd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-9d82d14f-7777-483b-be19-cefc669bbecd" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-9d82d14f-7777-483b-be19-cefc669bbecd" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e83349-acdb-45a6-9075-7409a26b925a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:43 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd Sep 28 19:27:43 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:43 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd" returned: 0 in 0.353s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:43 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd Sep 28 19:27:43 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:44 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9d82d14f-7777-483b-be19-cefc669bbecd" returned: 0 in 0.236s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-9d82d14f-7777-483b-be19-cefc669bbecd" released by "delete_volume" :: held 0.645s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Created reservations ['f45a313f-68e5-4f63-b013-84831169a05d', '1e8da620-cbe5-4470-bac1-500f6f49b272', '4945934b-3751-4d85-81ad-33f80d899057', '3fae3f05-9b97-4d09-afc6-f180afcb9569'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:44 devstack sudo[109611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:27:44 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:44 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:27:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Deleted volume successfully. Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-03887144-48e9-4554-a952-13cdad16963a tempest-ProjectReaderTests-657341730 None] Lock "cinder-9d82d14f-7777-483b-be19-cefc669bbecd-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Flow 'volume_create_manager' (16fad7f7-15fb-45cb-a02f-f462821ec87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8578127c-f248-464c-8ad0-4fcaf83aed11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8578127c-f248-464c-8ad0-4fcaf83aed11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907030939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fbbf81f1f450792f917a74a4a1ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:45Z,use_quota=True,user_id='dece7269b44d4b8e9bc5b8492cd49148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11e3b9f-69a2-49e3-bca6-ac2c3f3dc750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11e3b9f-69a2-49e3-bca6-ac2c3f3dc750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b22e23-7cbc-4968-8c13-ed9b9d97cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b22e23-7cbc-4968-8c13-ed9b9d97cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a', 'volume_name': 'volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c56e315-6bd5-49d3-83fc-ba44184d8517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c56e315-6bd5-49d3-83fc-ba44184d8517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e947697a-01c5-4aa6-be89-d0f50447ae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Volume e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a', 'volume_size': 1} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907030939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fbbf81f1f450792f917a74a4a1ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:27:45Z,use_quota=True,user_id='dece7269b44d4b8e9bc5b8492cd49148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Creating volume e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:27:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:27:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:45 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a 1073741824 Sep 28 19:27:45 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:45 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a 1073741824" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:45 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a Sep 28 19:27:45 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:45 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:27:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e947697a-01c5-4aa6-be89-d0f50447ae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff33ab8b-50e6-4e8d-b068-165a60edae0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:27:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Volume volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a (e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a): created successfully Sep 28 19:27:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff33ab8b-50e6-4e8d-b068-165a60edae0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:27:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Flow 'volume_create_manager' (16fad7f7-15fb-45cb-a02f-f462821ec87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:27:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0251c0f9-a50e-49bc-9891-2b80431f2f86 tempest-ProjectReaderTests-657341730 None] Created volume successfully. Sep 28 19:27:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Creating offline snapshot 6cf82d90-9e5c-4315-a226-9f1d877c0f91 of volume e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 19:27:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea27d370-9039-47a4-9a17-839aa91b60f3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:46 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a Sep 28 19:27:46 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:46 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" returned: 0 in 0.353s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:46 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 1G Sep 28 19:27:46 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:46 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 1G" returned: 0 in 0.396s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:46 devstack sudo[109634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 Sep 28 19:27:46 devstack sudo[109634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:47 devstack sudo[109634]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a -F qcow2 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:47 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 is being set with open permissions: ugo+rw Sep 28 19:27:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:47 devstack sudo[109639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 Sep 28 19:27:47 devstack sudo[109639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:47 devstack sudo[109639]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91" returned: 0 in 0.239s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:47 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.info Sep 28 19:27:47 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:47 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.info" returned: 0 in 0.253s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:47 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.info is being set with open permissions: ugo+rw Sep 28 19:27:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:47 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.info Sep 28 19:27:47 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:47 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.info" returned: 0 in 0.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f71c7985-5759-4e23-b2c5-d01c539e8527 tempest-ProjectReaderTests-657341730 None] Create snapshot completed successfully Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-6cf82d90-9e5c-4315-a226-9f1d877c0f91-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Lock "cinder-6cf82d90-9e5c-4315-a226-9f1d877c0f91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-6cf82d90-9e5c-4315-a226-9f1d877c0f91" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-6cf82d90-9e5c-4315-a226-9f1d877c0f91" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Deleting offline snapshot 6cf82d90-9e5c-4315-a226-9f1d877c0f91 of volume e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] snapshot_file for this snap is: volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2111a1ca-8d43-4f1d-85c2-3219a89ba737]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:48 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 Sep 28 19:27:48 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:48 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc11999-d742-4252-acd5-beb2828ed3a0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:48 devstack sudo[109653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a Sep 28 19:27:48 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:49 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:49 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 Sep 28 19:27:49 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:49 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91" returned: 0 in 0.332s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:49 devstack sudo[109664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91 Sep 28 19:27:49 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:49 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a.6cf82d90-9e5c-4315-a226-9f1d877c0f91" returned: 0 in 0.237s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-6cf82d90-9e5c-4315-a226-9f1d877c0f91" released by "_delete_snapshot" :: held 1.362s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" released by "delete_snapshot" :: held 1.385s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:49 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Created reservations ['c893fc43-1e8c-4ed7-886e-490007aeedd8', 'c2e34290-c411-4cdd-a169-79f138bca9e4', 'eeac2d7c-387c-43b8-a6f9-e7663f39cad3', '25b634f5-6cb4-4c40-8e75-4968213af249'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Delete snapshot completed successfully. Sep 28 19:27:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec5d3aa4-9c28-4ba8-979a-209d4addea00 tempest-ProjectReaderTests-657341730 None] Lock "cinder-6cf82d90-9e5c-4315-a226-9f1d877c0f91-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Lock "cinder-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Acquiring lock "cinder-quobyte-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:27:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:27:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52b7c5d-6e06-41b4-a0b0-889ef6009e1e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:27:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:50 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a Sep 28 19:27:50 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:50 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" returned: 0 in 0.361s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:50 devstack sudo[109672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a Sep 28 19:27:50 devstack sudo[109672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:51 devstack sudo[109672]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" returned: 0 in 0.244s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Lock "cinder-quobyte-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a" released by "delete_volume" :: held 0.662s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Created reservations ['314f225f-c49d-4239-ab32-d33eb514199a', 'a8e05790-0c3e-4b9c-85bf-079ddaab12d6', '76f733cb-e420-4042-bfdb-12703f2965c3', '9fa070f4-cebc-47f2-9733-bd4a4499f424'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:27:51 devstack sudo[109675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:27:51 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:27:51 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:27:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Deleted volume successfully. Sep 28 19:27:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f27b9df9-2b5b-45b4-9669-71d074fd4e35 tempest-ProjectReaderTests-657341730 None] Lock "cinder-e8d3e9b0-3a16-4c7b-9bab-bc2ab6e5ed2a-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:28:01 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=113,cinder:INSERT=39,cinder:UPDATE=135,cinder:DELETE=14 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:28:01 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=101,cinder:INSERT=39,cinder:UPDATE=145,cinder:DELETE=8 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Flow 'volume_create_manager' (46588adf-ae1e-441c-82c5-aa0fd4593b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b116f4c6-ef6e-4af0-a0f7-558fc898f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b116f4c6-ef6e-4af0-a0f7-558fc898f482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441752133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2bd7ef-08e3-42e0-a524-ef93109af458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12aa938eedf94cc096f78e1ea8abf9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:28:03Z,use_quota=True,user_id='55823050d21d424eb6bb5ecde66d11e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0dabc3-c28b-4773-a67d-5756d6d87dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0dabc3-c28b-4773-a67d-5756d6d87dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b4be86-9a64-4c25-8cb9-30eed57dda2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b4be86-9a64-4c25-8cb9-30eed57dda2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2bd7ef-08e3-42e0-a524-ef93109af458', 'volume_name': 'volume-9f2bd7ef-08e3-42e0-a524-ef93109af458', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd64ef0d-a487-4be9-9b1f-b50333bfa478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd64ef0d-a487-4be9-9b1f-b50333bfa478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3c8a24-9e1a-4659-94b1-ef94461ca33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Volume 9f2bd7ef-08e3-42e0-a524-ef93109af458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2bd7ef-08e3-42e0-a524-ef93109af458', 'volume_size': 1} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441752133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2bd7ef-08e3-42e0-a524-ef93109af458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12aa938eedf94cc096f78e1ea8abf9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:28:03Z,use_quota=True,user_id='55823050d21d424eb6bb5ecde66d11e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Creating volume 9f2bd7ef-08e3-42e0-a524-ef93109af458 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:28:02 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:28:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:02 devstack sudo[109680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458 1073741824 Sep 28 19:28:02 devstack sudo[109680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:03 devstack sudo[109680]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458 1073741824" returned: 0 in 0.417s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:03 devstack sudo[109685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458 Sep 28 19:28:03 devstack sudo[109685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:03 devstack sudo[109685]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3c8a24-9e1a-4659-94b1-ef94461ca33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2bd7ef-08e3-42e0-a524-ef93109af458', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e245f1d0-e5e3-4f1a-82e9-487858b31981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:03 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Volume volume-9f2bd7ef-08e3-42e0-a524-ef93109af458 (9f2bd7ef-08e3-42e0-a524-ef93109af458): created successfully Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e245f1d0-e5e3-4f1a-82e9-487858b31981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Flow 'volume_create_manager' (46588adf-ae1e-441c-82c5-aa0fd4593b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:28:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-28047c49-72c6-4249-88a1-1ca17ef67df0 tempest-ProjectReaderTests-1506097820 None] Created volume successfully. Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "cinder-9f2bd7ef-08e3-42e0-a524-ef93109af458-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-9f2bd7ef-08e3-42e0-a524-ef93109af458-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:28:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "cinder-quobyte-9f2bd7ef-08e3-42e0-a524-ef93109af458" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-quobyte-9f2bd7ef-08e3-42e0-a524-ef93109af458" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6a3bad-d300-4e81-b867-0d41c4069ba5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:04 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458 Sep 28 19:28:04 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:04 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:04 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458 Sep 28 19:28:04 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:04 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-9f2bd7ef-08e3-42e0-a524-ef93109af458" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-quobyte-9f2bd7ef-08e3-42e0-a524-ef93109af458" released by "delete_volume" :: held 0.634s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Created reservations ['366da6a2-7c8a-4fa3-bdd9-a744398a01b0', '1d1704a5-aa4e-444e-a80d-8775599d3c7f', '001035be-855a-491d-9f17-1f60b0dd4970', 'db59f2f2-408e-48d3-a7a0-661e44197f84'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:04 devstack sudo[109696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:28:04 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:04 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.244s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:04 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:28:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Deleted volume successfully. Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25c98c92-0c77-4ced-a2b5-d288059e9d17 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-9f2bd7ef-08e3-42e0-a524-ef93109af458-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Flow 'volume_create_manager' (727b0644-953c-489e-a7fe-156853424c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4c213a-520e-4e1f-b8e7-12ab2130b701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4c213a-520e-4e1f-b8e7-12ab2130b701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1636373021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a121b911-005e-4f9e-89ac-e6c6667fb5df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12aa938eedf94cc096f78e1ea8abf9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:28:05Z,use_quota=True,user_id='55823050d21d424eb6bb5ecde66d11e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75a677f-5d29-4a12-a8d4-71f6b9dac77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75a677f-5d29-4a12-a8d4-71f6b9dac77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f226158f-aa5a-4788-9ae5-d1ade14ea3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f226158f-aa5a-4788-9ae5-d1ade14ea3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a121b911-005e-4f9e-89ac-e6c6667fb5df', 'volume_name': 'volume-a121b911-005e-4f9e-89ac-e6c6667fb5df', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71f7796-7e7c-453f-ac25-ad697ca4f9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71f7796-7e7c-453f-ac25-ad697ca4f9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e96313-c8bf-4df2-afb3-ca4cf0858ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Volume a121b911-005e-4f9e-89ac-e6c6667fb5df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a121b911-005e-4f9e-89ac-e6c6667fb5df', 'volume_size': 1} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1636373021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a121b911-005e-4f9e-89ac-e6c6667fb5df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12aa938eedf94cc096f78e1ea8abf9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:28:05Z,use_quota=True,user_id='55823050d21d424eb6bb5ecde66d11e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Creating volume a121b911-005e-4f9e-89ac-e6c6667fb5df {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:28:05 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:05 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df 1073741824 Sep 28 19:28:05 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:05 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df 1073741824" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:06 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df Sep 28 19:28:06 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:06 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df" returned: 0 in 0.236s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e96313-c8bf-4df2-afb3-ca4cf0858ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a121b911-005e-4f9e-89ac-e6c6667fb5df', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1794acc-003e-4e84-9107-24c9cb8eec8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:06 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Volume volume-a121b911-005e-4f9e-89ac-e6c6667fb5df (a121b911-005e-4f9e-89ac-e6c6667fb5df): created successfully Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1794acc-003e-4e84-9107-24c9cb8eec8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Flow 'volume_create_manager' (727b0644-953c-489e-a7fe-156853424c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:28:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b8460687-4ead-4fad-bb13-81e48bb1f3a4 tempest-ProjectReaderTests-1506097820 None] Created volume successfully. Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "cinder-a121b911-005e-4f9e-89ac-e6c6667fb5df-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-a121b911-005e-4f9e-89ac-e6c6667fb5df-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "cinder-quobyte-a121b911-005e-4f9e-89ac-e6c6667fb5df" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-quobyte-a121b911-005e-4f9e-89ac-e6c6667fb5df" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c353bc9-9078-45f2-9472-a2eefbf32df7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:28:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:06 devstack sudo[109708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df Sep 28 19:28:06 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:07 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df" returned: 0 in 0.373s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:07 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df Sep 28 19:28:07 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:07 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a121b911-005e-4f9e-89ac-e6c6667fb5df" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-quobyte-a121b911-005e-4f9e-89ac-e6c6667fb5df" released by "delete_volume" :: held 0.662s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Created reservations ['4d8f75bc-6630-42e7-a88c-13602e06b6a4', '0a10fda1-2698-4d01-852e-ec75a1de06e6', 'd1604e2a-5d63-448b-afc1-c39cf242be25', 'a2601821-9681-4dd3-9830-178ed7a38840'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:07 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:28:07 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:07 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.238s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:28:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Deleted volume successfully. Sep 28 19:28:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5e77b76-0cc7-48bf-ab06-6aa9b33873f5 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-a121b911-005e-4f9e-89ac-e6c6667fb5df-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Flow 'volume_create_manager' (d6ea7c19-6edd-430f-b1bc-8257cd7b0945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bf5d85-f662-4d87-a5b7-7cb67c92025f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bf5d85-f662-4d87-a5b7-7cb67c92025f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593181047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2740685-ca83-4489-a50f-43410ac97f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12aa938eedf94cc096f78e1ea8abf9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:28:08Z,use_quota=True,user_id='55823050d21d424eb6bb5ecde66d11e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69e50c5-c88f-47cf-8fb8-af53bbdcc65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69e50c5-c88f-47cf-8fb8-af53bbdcc65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1b450d-0b1c-40aa-b2b0-ae39c390920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1b450d-0b1c-40aa-b2b0-ae39c390920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2740685-ca83-4489-a50f-43410ac97f7e', 'volume_name': 'volume-a2740685-ca83-4489-a50f-43410ac97f7e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f37048f-0b31-42c2-8819-733dd832c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f37048f-0b31-42c2-8819-733dd832c122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07b177c-ed18-41c0-b83b-a5a8efb4359b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Volume a2740685-ca83-4489-a50f-43410ac97f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2740685-ca83-4489-a50f-43410ac97f7e', 'volume_size': 1} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593181047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2740685-ca83-4489-a50f-43410ac97f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12aa938eedf94cc096f78e1ea8abf9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:28:08Z,use_quota=True,user_id='55823050d21d424eb6bb5ecde66d11e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Creating volume a2740685-ca83-4489-a50f-43410ac97f7e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:28:08 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:08 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e 1073741824 Sep 28 19:28:08 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:08 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e 1073741824" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:08 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e Sep 28 19:28:08 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:08 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e" returned: 0 in 0.243s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07b177c-ed18-41c0-b83b-a5a8efb4359b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2740685-ca83-4489-a50f-43410ac97f7e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a92e9c-23ad-4926-8604-62a507a8fb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Volume volume-a2740685-ca83-4489-a50f-43410ac97f7e (a2740685-ca83-4489-a50f-43410ac97f7e): created successfully Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a92e9c-23ad-4926-8604-62a507a8fb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Flow 'volume_create_manager' (d6ea7c19-6edd-430f-b1bc-8257cd7b0945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:28:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-943b3450-5c49-4b9a-989c-6ed0b7f92913 tempest-ProjectReaderTests-1506097820 None] Created volume successfully. Sep 28 19:28:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "cinder-a2740685-ca83-4489-a50f-43410ac97f7e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:28:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-a2740685-ca83-4489-a50f-43410ac97f7e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:28:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "cinder-quobyte-a2740685-ca83-4489-a50f-43410ac97f7e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:28:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-quobyte-a2740685-ca83-4489-a50f-43410ac97f7e" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:28:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c196b7-258c-4919-b238-58e7200d56c7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:28:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:09 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e Sep 28 19:28:09 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:09 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e" returned: 0 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:09 devstack sudo[109733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e Sep 28 19:28:09 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:09 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-a2740685-ca83-4489-a50f-43410ac97f7e" returned: 0 in 0.251s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-quobyte-a2740685-ca83-4489-a50f-43410ac97f7e" released by "delete_volume" :: held 0.654s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Created reservations ['6ffb6001-e690-49fc-a0e5-f78f63a83c1f', 'b59ddb7e-7e96-47d6-a315-03e57e1128c6', 'bcd1298e-64cf-4244-942a-48be895100fa', '2ae3b1ff-3050-40a9-99f6-3c2f57ae3fff'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:10 devstack sudo[109736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:28:10 devstack sudo[109736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:10 devstack sudo[109736]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.271s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:28:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Deleted volume successfully. Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bec6d61f-be50-4f28-bb22-93bfecefc659 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-a2740685-ca83-4489-a50f-43410ac97f7e-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Flow 'volume_create_manager' (508681e8-18df-4043-b599-0eaf90ff43b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d326c8-4735-4552-9c44-7b851c63773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d326c8-4735-4552-9c44-7b851c63773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1604881235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93681d8-b64a-4bb7-8813-50e71b58ce60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12aa938eedf94cc096f78e1ea8abf9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:28:11Z,use_quota=True,user_id='55823050d21d424eb6bb5ecde66d11e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d44037-9b88-4e00-9b31-3b0ded435f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d44037-9b88-4e00-9b31-3b0ded435f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06236241-4fc5-40a4-91e3-9e49b7301399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06236241-4fc5-40a4-91e3-9e49b7301399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93681d8-b64a-4bb7-8813-50e71b58ce60', 'volume_name': 'volume-c93681d8-b64a-4bb7-8813-50e71b58ce60', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76256f2f-30f8-463f-931a-de18aace8045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76256f2f-30f8-463f-931a-de18aace8045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec56b54-c0c6-439b-9a6f-3cde9f60b0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Volume c93681d8-b64a-4bb7-8813-50e71b58ce60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93681d8-b64a-4bb7-8813-50e71b58ce60', 'volume_size': 1} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T17:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1604881235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93681d8-b64a-4bb7-8813-50e71b58ce60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12aa938eedf94cc096f78e1ea8abf9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T17:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T17:28:11Z,use_quota=True,user_id='55823050d21d424eb6bb5ecde66d11e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370211e9-7ab7-43e0-a252-e165016b6437),volume_type_id=370211e9-7ab7-43e0-a252-e165016b6437)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Creating volume c93681d8-b64a-4bb7-8813-50e71b58ce60 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Selected osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 19:28:10 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] casted to osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca Sep 28 19:28:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:10 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60 1073741824 Sep 28 19:28:10 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:11 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60 1073741824" returned: 0 in 0.395s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:11 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60 Sep 28 19:28:11 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:11 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60" returned: 0 in 0.236s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec56b54-c0c6-439b-9a6f-3cde9f60b0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93681d8-b64a-4bb7-8813-50e71b58ce60', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa79b5f-808b-45ee-b404-a56d04e8989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 19:28:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Volume volume-c93681d8-b64a-4bb7-8813-50e71b58ce60 (c93681d8-b64a-4bb7-8813-50e71b58ce60): created successfully Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa79b5f-808b-45ee-b404-a56d04e8989b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Flow 'volume_create_manager' (508681e8-18df-4043-b599-0eaf90ff43b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 19:28:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b70ccca8-a668-4391-84fd-2d9271a1c108 tempest-ProjectReaderTests-1506097820 None] Created volume successfully. Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "cinder-c93681d8-b64a-4bb7-8813-50e71b58ce60-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-c93681d8-b64a-4bb7-8813-50e71b58ce60-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "cinder-quobyte-c93681d8-b64a-4bb7-8813-50e71b58ce60" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-quobyte-c93681d8-b64a-4bb7-8813-50e71b58ce60" acquired by "delete_volume" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 19:28:11 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e07ee2-d4f5-453a-b043-ff44ec804350]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:12 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60 Sep 28 19:28:12 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:12 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60" returned: 0 in 0.375s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:12 devstack sudo[109756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60 Sep 28 19:28:12 devstack sudo[109756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:12 devstack sudo[109756]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d/volume-c93681d8-b64a-4bb7-8813-50e71b58ce60" returned: 0 in 0.240s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-quobyte-c93681d8-b64a-4bb7-8813-50e71b58ce60" released by "delete_volume" :: held 0.653s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Created reservations ['c8da2483-b856-4dc4-84a2-fe4e7c119e35', 'b2406c8d-a2bc-4fc4-86a4-32655ddb964a', '0d0a8eed-641e-49b0-8e1f-6fbb0b791dae', '17ed9d82-c855-4a60-a47f-7cca663f4625'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:12 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:28:12 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:12 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.249s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:12 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:28:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Deleted volume successfully. Sep 28 19:28:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-02cddb07-478c-4837-9b64-2fd24fd0aa50 tempest-ProjectReaderTests-1506097820 None] Lock "cinder-c93681d8-b64a-4bb7-8813-50e71b58ce60-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 19:28:22 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=48,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:28:22 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=27,cinder:UPDATE=40,cinder:DELETE=4,cinder:INSERT=12 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-685956b4-f109-4c58-aa92-9863712701ca'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 19:28:34 devstack sudo[110081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d Sep 28 19:28:34 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 19:28:34 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e6be52130f484d5d1c3f1d3b9a85a70d" returned: 0 in 0.246s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 19:28:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2f8133fb-51a6-4119-9634-570bead669b7 None None] thread info: [<_MainThread(MainThread, started 130409662353536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}